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FOREWORD 


In  my  capacity  as  Chairman  of  the  Aerospace  Medical  Panel  of  AGARD  It  is  a  pleasure  to 
introduce  this  collection  of  papers,  which  were  presented  at  the  USAF  School  of  Aerospace 
Medicine,  Brooks  Air  Force  Base.  Texas  on  14  and  15  May  1969. 

Thu  decision  to  hold  u  symposium  on  the  topic  of  "The  Flight  Deck  Workload  and  its 
Relation  to  Pilot  Performance"  was  made  by  the  ASMP  on  the  recommendation  of  its  recently 
constituted  Behavioral  Sciences  Committee.  The  topic  Is  a  broad  one,  so  It  wan  not  possible 
to  do  more  than  highlight  certain  aspects  of  the  problem  in  the  one  and  a  half  days  which 
were  available. 

The  symposium  drew  attention  to  the  difficulties  associated  with  the  quantitative 
assessment  of  workload,  and  the  prediction  of  performance  decrement  consequent  to  high  or 
prolonged  workloads.  Whereas  the  effect  of  speci  fie  components  of  workload  (e.  g.  thermal 
stress)  on  pilot  efficiency  Is  understood  to  an  extent  which  allows  the  aeromedical 
specialist  to  offer  an  evaluated  opinion  to  the  operational  commander,  a  comparable  situa¬ 
tion  does  not  yet  exist  when  a  mo',  e  general  assessment  has  to  be  made  of  the  aviator’s 
workload  and  the  operational  consequences  predicted. 

In  the  absence  of  any  global  solution  to  the  problem  it  was  reassuring  to  find  work  in 
progress  in  two  major  areas.  One  was  concerned  with  the  study  of  short-term  high  workload 
during  approach  and  landing,  the  other  with  an  examination  of  the  factors,  such  as  sleep 
loss  and  duty  schedules,  which  determine  the  long-term  workload. 

These  topics  are  of  operational  importance  In  civil  as  well  as  military  flying. 
Accordingly,  I  was  gratified  to  find  that  aeromedical  specialists  who  represented  these 
two  interests  contributed  to  che  symposium,  which  I  am  sure  provided  an  opportunity  for 
the  mutual  exchange  of  Information  between  workers  in  this  field  from  Europe  and  the  North 
American  Continent. 


Professor  Dr  Erwin  A. Lauschner 
Brigadier  General  MC,  GAF 
Chairman.  Aerospace  Medical  Panel 
AGARD/NATO 
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AVANT-PROPOS 


En  ma  quality  os  President  de  la  Commission  de  la  Mddecine  Adrospatlale  J’al  lo  plaisir 
da  presenter  ce  re  ueil  de  communications  qui  out  dtd  fnitoa  au  College  de  la  Mddecine 
Aerospatiale  de  1’  IJSAF,  Brooks  Air  Force  Base,  Texas,  les  14  ot  15  mai  1909. 

La  decision  d’  organiser  un  Symposium  consacrd  au  theme  "La  Charge  de  Travail  du  Poste 
de  Pilotage  et  son  Rapport  avec  les  Performances  du  Pilote"  a  dtait  prise  par  la  Commission 
sur  proposition  de  son  Comitd  rdeemment  erdd  sur  les  Sciences  du  Comportement.  Le  domaine 
couvert  par  ce  thdme  dtant  trds  large,  il  fallait  se  contenter,  au  cours  du  jour  et  deml 
dont  on  disposait,  a  mettre  en  lumidre  un  certain  nombre  d’  aspects  seulement  de  ce  probleme. 

Le  Symposium  a  attird  1’ attention  vers  les  difficultds  lides  a  l'dvaluation  quantitative 
de  la  charge  de  travail  et  1  la  prddiction  du  de'erdment  de  performance  du  a  des  charges  de 
travail  dlevdes  ou  prolongdes.  Alors  que  1' Influence,  sur  le  rendement  du  pilote.  d'dldments 
particulars  de  la  charge  de  travail  (par  exemple,  la  tension  thermique)  est  suffisamment 
connue  pour  permettre  au  spdcialiste  adromedlcal  d’ exprimer  au  pilote  commandant  de  bord 
une  opinion  dvalude,  cela  n’ est  pas  le  cas  lorsqu’ il  s’ agit  de  faire  une  ((valuation  plus 
gdne'rale  de  la  charge  de  travail  de  l’aviateur  et  d' en  prddire  les  rdpercussicns  dans  des 
conditions  d’  exploitation  de  1’  avion, 

En  1‘ absence  d' une  solution  globale  du  probleme,  il  a  6te  rassurant  de  constater  que 
des  travaux  sont  on  cours  dans  deux  grands  domaines.  L’  un  de  ces  domaines  se  portc  sur 
l’dtude  d’ une  charge  de  travail  e'levee  &  court  terme  lors  de  1’  approche  et  de  1’ atterrissage, 
et  1’ autre  sur  r  examen  des  facteurs,  fels  que  perte  de  sommeil  et  programmes  de  service, 
qui  determinent  la  charge  de  travail  d  long  terme. 

Ces  thdmes  sont  d’ une  importance  opdrationnelle  tant  pour  1' aviation  civile  que  militaire. 
J’  ai  ete  en  consequence  trds  heureux  que  des  spdcialistes  adromedicaux  s'  occupant  de  ces 
doux  interets  aient  fait  des  contributions  au  Symposium,  qui,  j’en  suis  sQr,  a  fourni 
1’ occasion  d’ uu  echange  d' informations  entre  ceux  qui  travaillent  dans  ce  domaine  en 
Europe  et  dans  le  continent  nord-aradricain. 


A- 


Professor  Dr  Erwin  A, Lauschner 
Brigadier  General  MC,  GAF 
Chairman,  Aerospace  Medical  Panel 
AGARD/NATO 
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At  the  end  of  1964  a  small  group  was  formed  in  the  United  Kingdom  to  investigate  flight-deck 
vorkloads  in  civil  aircraft.  It  consisted  of  two  full-time  members  from  the  then  Ministry  of 
Aviation,  a  doctor  and  an  operations  officer,  both  pilots,  and  two  part-time  members,  physiologists 
from  the  R.A.F.  Institute  of  Aviation  Medicine,  Farnborcugh. 

Since  the  group  had  limited  resources  it  had  to  decide  which  of  the  many  possible  areas  it  was 
best  suited  to  study.  For  instance  it  was  felt  that  the  detailed  ergonomics  side  e.g.  crew  work¬ 
space,  control  characteristics,  instrument  presentation,  etc.  could  probably  be  more  profitably 
studied  during  the  development  of  particular  aircraft  and  was  not  the  area  best  suited  to  the 
group's  capabilities.  It  was,  therefore,  decided  that  we  should  study  the  effect  of  the  total 
flying  environment  on  the  man  and  it  soon  became  clear  Vhat  the  work  could  be  conveniently  divided 
into  three  distinct  areas  as  follovs:- 

(i)  The  immediate  workload:  i.e.  the  workload  experienced  over  any  particular  short  period 
of  time,  e.g.,  take-off,  descent,  landing  or,  in  military  aircraft,  the  bombing  run  or 
the  attack  phase. 

(ii)  The  duty-day  workload:  i.e.  the  sum  total  of  the  sl.ort-term  workloads  experienced 
during  a  working  day. 

(iii)  The  long-term  workload:  i.e.  the  effect  of  the  sequences  of  working  days  over  a 

particular  roster  pattern  which  would  include  such  things  as  sleep  patterns  and  time 
zone  changes. 

The  methods  we  used  were  of  necessity  very  simple  and  unsophisticated  by  laboratory  standards. 
The  situation  in  a  civil  transport  aircraft  on  normal  commercial  operations  is  very  different  from 
that  in  a  military  or  research  aircraft.  In  fact  the  initial  part  of  the  work  was  largely  an 
exercise  in  public  relations.  In  these  circumstances  one  has  to  rely  entirely  on  the  goodwill  of 
the  airline,  the  Pilot's  Association  and  the  individual  pilots  themselves,  to  be  able  to  take 
biological  measurements  on  the  crews  or  even  to  be  in  the  cockpits  as  an  observer.  Above  all 
nothing  can  be  done  that  will  in  the  slightest  way  prejudice  the  skill  and  concentration  of  the 
crew  or  the  safety  of  the  aircraft.  If  one  is  following  a  crew  through  a  long-haul  duty  roster 
one  may  be  away  two  weeks  or  more  and  fly  in  four  or  more  different  aircraft  so  it  is  impracticable 
to  have  permanent  recording  installations  in  the  aircraft.  Similarly,  since  by  law  one  has  to 
travel  on  the  passenger  manifest,  at  each  stop  one  has  to  pass  through  customs  and  immigration  areas 
carrying  the  equipment  with  normal  baggage.  Finally,  for  many  reasons,  we  found  it  best  to  be 
independent  of  aircraft  power  supplies  and  to  be  battery  operated.  This  placed  a  severe  restriction 
on  the  amount  and  type  of  equipment  we  were  able  to  carry. 

In  the  event,  we  were  given  full  co-operation  from  the  airlines  and  RALPA  and  quite  remarkable 
co-operation  from  the  crews  we  used  as  subjects.  Our  methods  and  results  are  best  described  under 
the  three  headings  previously  mentioned. 

IMMEDIATE  WORKLOAD 

It  was  felt,  at  a  very  early  stage,  that  in  investigating  the  immediate  workload  we  were 
interested  in  the  man's  level  of  arousal  and  its  relationship  to  the  complexity  of  the  job  in  hand. 
There  is  at  present  no  simple  and  dii set  way  of  measuring  arousal,  but  there  are  several  secondary 
measures  which  can  be  said  to  be  indicators  of  change  in  arousal  level  e.g,  skin  conductivity, 
muscle  tone,  respiratory  rate  and  heart  rate.  Of  these  we  chose  heart  rate  as  being  the  most 
reliable,  simple  to  record  and  offering  the  least  interference  to  the  subjects.  The  captain's 
E.C.G.  was  taken  from  three  conventional  chest  leads:  amplified,  filtered  and  the  R  wave  made  to 
trigger  a  300c. p.s.  tone  that  was  recorded  on  tape.  At  the  same  time  the  observer,  who  sat  on  the 
jump-seat  behind  the  captain,  recorded  on  the  same  tape  a  running  commentary  of  events  as  they 
happened  in  the  cockpit.  On  return  from  each  trip  the  heart  beats  were  counted  in  real  time, 
plotted  in  the  number  of  beats  in  each  minute  of  the  trip  and  then  matched  with  events  as  recorded 
from  the  commentary.  An  example  of  the  type  of  record  obtained  is  shown  in  Fig.  1 .  This  shows 
four  day's  flying  on  a  six-day  trip  to  Bangkok  and  return.  The  most  obvious  changes  are  those 
associated  with  tak-'-off,  top  of  descent,  and  descent  and  landing.  On  sectors  when  the  first 
officer  is  flying,  the  record  is  still  that  of  the  captain  and  it  can  be  seen  that  the  peaks  at 
take-off  and  landing  are  absent.  On  the  full  record  there  were  too  many  minor  points  of  interest 
to  include  in  a  short  paper  such  as  this  but  it  can  be  seen  that  as  well  as  flying  activities  such 
things  as  meals,  speaking  on  the  P.A.  and  sleeping  and  so  on  are  easily  identifiable.  An  example 
of  how  reliable  an  indicant  of  mental  activity  is  the  heart  rate  can  be  shown  by  two  landings  at 
Teheran.  There  .ire  three  beacons  over  which  the  aircraft  must  be  positioned  at  particular  heights 
and  the  records  show  peaks  corresponding  to  each  of  the  beacons  during  both  landings. 

When  using  heart  rates  as  an  indicant  of  arousal  level  it  is  essential  to  know  your  subject 
and  his  heart-rate  well.  For  instance  after  several  flights  with  this  particular  pilot  we  judged 
that,  when  his  heart  rate  exceeded  1  50  beats  in  a  minute  whilst  flying,  lie  was  at  or  near  the  peak 
of  his  arousal  level  that  would  seem  desirable  for  maximum  efficiency.  It  will  be  noted  in  Fig.  1 
that  .it  Bombay  his  heart  rate  exceeds  150.  This  was  a  difficult  approach  since  it  was  a  dark  right, 
there  had  been  some  problems  of  radar  identification,  and  Bombay  at  that  time  had  a  3;.  degree  glide 
slipe  on  its  I.L.o.  which  was  uncomfortably  steep  for  a  Boeing  707.  The  arbitrary  level  of,  in 
this  rise.  I  Mi  was  admittedly  no  more  than  an  informed  guess  gathered  from  experience.  These 
records  are  r.ov  quite  old  (fins  was  19u5)  and  we  have  advanced  considerably  since  then. 
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Squadron  Leader  Nicholson,  vho  is  a  member  of  our  group,  in  a  later  paper,  will  describe  how  he 
has  taken  this  a  step  further  and,  with  the  same  pilot,  has  confirmed  that  when,  during  a  landing, 
his  heart  rate  reaches  approximately  150  beats  per  minute  there  are  other  signs  which  suggest 
definite  changes  in  his  physiological  state. 

As  an  Interesting  aide-line  to  this,  we  noticed  that  the  captain's  heart  rate  did  not  rise 
in  the  usual  steps  from  top  of  descent  to  landing  when  the  first  officer  flew  the  aircraft.  We 
therefore  thought  it  reasonable  to  suppose  that,  on  difficult  approaches,  if  the  first  officer 
brought  the  aircraft  into  say  five  miles  out  and  at  1,500  feet  and  the  captain  then  took  over, 
the  captain  would  start  the  final  approach  at  a  lower  level  of  arousal  and  land  the  aircraft  at  a 
lower  peak  of  heart  rate.  We  arranged  to  carry  out  two  trips  to  Hongkong  and  return  with  the  same 
crew  in  a  Boeing  707  and  thus  have  two  sets  of  landings,  one  with  the  captain  flying  the  yhole  of 
descent  and  landing  and  the  other  with  a  shared  approach,  fig.  2  shews  the  captain's  heart  rates 
for  both  types  of  landing  and  it  can  be  seen  at  Calcutta  and  Hongkong  where  the  normal  landing 
produced  very  high  heart  rates  the  shared  landing  was  markedly  lower. 

One  final  word  on  heart  rates.  We  did  for  some  time  consider  measuring  r-r  variability 
throughout  the  trip.  We  have  done  this  on  seme  of  our  records;  in  Fig.  3  the  r-r  intervals  are 
plotted  for  the  last  part  of  ar.  approach  and  landing  by  a  captain  of  a  BAC  111.  The  variability 
is  low  while  he  is  flying  on  instruments  down  to  'field  in  sight',  (F.I.S.).  When  the  field  is  in 
sight  the  pilot  looks  up  and  goes  visual.  In  this  particular  instance  he  is  in  a  good  position, 
the  weather  is  good,  the  landing  is  an  easy  ore  and  the  variability  increases  directly.  We  have 
done  some  ground  experiments  to  see  how  useful  this  could  be  to  compare  the  same  task  during 
different  fatigue  states  and  we  find  that,  although  certainly  as  mental  work  increases  the  r-r 
variability  decreases,  the  difference  between  the  same  man  on  different  days  is  so  great  that  we 
have  not  found  it  useful  to  continue  with  this  aspect  of  heart  rate  analysis. 

To  summarise;  there  is  still  very  much  more  work  to  be  done  in  this  field  but  evidence 
obtained  so  far  docs  suggest  that  a  reasonable  assessment  of  immediate  workload  may  be  obtained 
by  physiological  measures  in  the  not  too  distant  future. 

DUTY  DAY 


For  assessment  of  the  'duty  day'  workload  we  used  three  approaches:- 

1.  We  collected  all  the  pilot's  urine,  in  separate  samples  throughout  the  trip,  for 
return  to  the  R.A.F.  Institute  of  Aviation  Medicine  and  subsequent  biochemical 
analysis. 

2.  At  approximately  hrs.  after  the  final  landing  on  each  flying  day,  and  at  18.00  hrs. 
on  each  rest  day,  we  asked  the  pilot  to  fill  in  a  'state  of  fatigue*  questionnaire 
which  gave  a  score,  with  a  maximum  of  20  points,  of  the  pilot's  subjective  feelings 

of  fatigue, 

3.  A  variety  of  post-flight  psychological  tests  were  used  in  an  attempt  to  show  changes 
in  performance  that  could  be  correlated  with  fatigue  or  with  length  of  duty  day. 

The  urine  samples  were  taken  specifically  before  and  after  sleep,  before  take-off  and  after 
landing.  All  the  other  times  were  left  to  the  subject's  natural  wishes.  The  main  estimations 
made  in  the  subsequent  analyses  were  of  adrenaline,  nor-adrenaline,  sodium,  inorganic  phosphate, 
potassium,  nitrogen  and  parahydroxyphenyllactic  acid.  Of  these,  adrenaline  was  found  to  be  by  far 
the  most  consistent  and  useful.  However,  although  the  results  were  interesting,  it  was  not  found 
possible  to  use  adrenaline  as  a  finely  quantitative  measure  of  work  done  in  the  sense  of  work 
leading  to  fatigue.  This  is  understandable  when  one  remembers  the  many  subtle  influences  that 
govern  the  excretion  of  adrenaline.  Thus,  two  seemingly  identical  flights  would  show  differences 
in  adrenaline  excretion  by  a  factor  of  as  much  as  2  if  one  were  at  night  and  the  other  by  day. 

Again,  on  occasions  a  pilot's  adrenaline  output  could  be  more  on  his  rest  day  than  on  his  flying 
day.  Also  it  was  found  that  one  somewhat  alarming  incident  lasting  perhaps  30  seconds  could  increase 
the  duty  day's  total  adrenaline  output  by  as  much  as  two  thirds. 

Our  use  of  post  flight  pyschological  tests  led  to  disappointment.  The  restrictions  on  the 
weight  and  bulk  of  equipment  we  could  carry,  and  the  limitation  on  the  pilot’s  time  after  a  long 
flight  that  we  felt  we  could  reasonably  ask  for,  limited  the  types  of  tests  we  could  apply.  We 
used  simple  mathmatical  and  card  sorting  tests  and  a  modified  Stroop  test.  We  obtained  no 
consistent  results  that  could  be  correlated  with  work  done  or  with  the  subjects  fatigue  estimates. 

The  post  flight  subjective  fatigue  scores  were  most  useful  and  the  subjects  were  very  soon 
able  to  use  them  consistently.  Each  subject  had  his  own  interpretation  of  the  questionnaire  so 
that  there  could  be  no  direct  comparison  of  scores  between  subjects,  but  for  each  subject  the 
comparative  scores  matched  very  well  the  observer's  estimate  of  the  man's  day’s  work  and  his 
apparent  level  of  fatigue. 

Thus  to  summarise  the  duty  day:  we  have  tried  very  hard  to  find  an  objective  measure  that  can 
be  used  to  quantify  accurately  the  pilot's  daily  workload  or  its  effects.  We  have  so  far  failed  to 
find  such  a  measure  but  a  subjective  estimate  of  fatigue  by  a  well  motivated  subject  is  a  useful 
alternative. 


LOtff;  TfiKH  WUPKLOAD 


V/e  kn  kt'j  of  no  biological  r.i-asure  *'l  lei,/  !nm  v<ifri<-id.  Ow*  N.<*  e.n'-.i  ■  ;n-.  i  ■  t i  nl.  o<»i  rt*  I -H.  J  on*; 
in  our  iMJlier  studios  of  long-haul  operation*-  v.e.  between  sloop  pitti-rn--  .ukI  pnst  j  I  igl  t  faiigui: 
scores  *  In  consequence .  v  f>  Iiwp  vs.  iv.  i  \.‘y  -;u. ,»  «  .  \*»  :}n-  i»«ng 

term.  Our  method  is  to  issue*  the  crews  with  **.|  < <:  i  .til  y  pi  inif‘1  di-irMM;  .  n  vhwh  V.u-y  rrcia-l  «\k/1i 
day  t;h»*  t  -*•  they  go  to  sleep,  the  time  they  wake,  duty  t  inw  •:  .iniJ  He  .n;  wi-r>;  »<>  ,i  j.u.gui- 
questionnaire.  From  these  we  have  obtained  much  ushuI  mi  •i-matiou  <>n  ir-il,  jung  .md  >,h«irt -h-ml 
opera t ions • 


An  example  is  shown  in  Fig.  d.  it  shows  tile  sleep  pattern*.  »nd  living  |i»Ti«up-.  »r  two 
subjects,  Captain  CIO  and  Cll,  on  a  two  week  shuttle  between  has  and  pi*,  fie  J« -ut  iro. 

The  sleep  has  been  plotted  horizontally  in  real  time  unit*;  and  the  1  sleep  credit  '  has  L*  vi  dn/wn 
vertically  on  an  arbitrary  scale.  The  rate  nt  which  sleep  cielit  is  assumed  to  U*  exhausted  i1 
denoted  by  the  diagonal  lines  whose  slope*  arc  at  an  angle  to  the  vertical,  equivalent  to  the  lo-j*. 
of  eight  hours  sleep  ciedit  in  sixteen  waking  hours. 

The  flying  duty  periods  are  plotted  on  the  same  base- line  as  the  sleep  pej  iodg  and  where  the 
'credit'  slope  reaches  the  base  line  is  where  the  subject  is  presumed  >o  have  exhaust  :*l  his  sleep 
credit.  In  this  admittedly  oversimplified  representation  no  attempt  his  been  made  to  adjust  the 
sleep  credit  for  previously  incurred  sleep  debts. 

Captains  CIO  and  Cl  1  carried  out  the  same  flying  programme,  one  I!  weeks  after  the  other. 

There  was  one  slight  difference  in  that,  due  to  an  engine  failure#  Captain  CIO's  flight  on  the 
morning  of  Day  ^  was  curtailed  by  an  emergency  return  to  Las  Palmas  and  the  flight  completed 
later  in  the  day. 

A  comparison  between  the  sleeping  patterns  of  Captains  CIO  and  Cl  1  shows  that  Captain  CIO 
was  able  to  arrange  his  sleep  in  a  much  more  satisfactory  manner  than  was  Captain  Cl  1 .  This  was 
due  more  to  Captain  CTI's  inability  to  sleep  during  the  day  than  to  lack  of  planning.  The  points 
at  which  Captain  CIO's  'credit  slopes'  cut  the  base-line  were,  in  most  cases,  at  the  end  or  after 
the  end  of  his  flight.  On  Day  3  he  was  seme  3  hours  short  of  his  target  and  also  on  Day  13 
although  this  latter  was  difficult  to  judge  since  the  sleep  he  got  between  17. 00  and  23.00  was 
described  by  him  as  'dozing  and  reading'  and,  therefore,  has  been  plotted  in  dotted  line3. 

Captain  C11,  on  the  other  hand,  did  not  on  any  occasion  achieve  the  target  of  completing  the 
flight  before  running  out  of  sleep  credit.  On  one  occasion,  Day  9,  he  was  out  of  credit  before 
the  flight  began. 

Fig.  5  shows  the  thrcc-day  moving  average  of  sleep  for  the  two  captains.  Also  arc  shown 
their  mean  sleep  per  day  for  the  duty  period  and  their  normal  mean  sleep  per  day  Calculated  from 
a  period  of  leave  when  their  sleep  was  not  affected  by  duty  flights  nor  the  recovery  period  from 
previous  flights.  It  can  b*  seen  that,  on  the  shuttle,  both  captains'  means  are  well  short  of 
their  normal  but  that  Captain  Cl  1  is  far  worse  than  Captain  CIO.  This  is  reflected  in  the 
subjective  fatigue  scores  (marked  on  the  sleep  and  duty  base-line)  of  which  Captain  CH's  are 
markedly  higher  at  the  end  of  the  period  than  at  the  beginning  whereas  Captain  CIO's  show  little 
change.  This  was  confirmed  by  the  observer's  impressions  that,  although  both  captains  were  tired 
at  the  end  of  the  fifteen  days,  Captain  C11  was  very  much  more  tired  than  CIO. 

Both  subjects  incurred  long-term  sleep  debts  which  continued  to  accumulate  during  the  second 
week  despite  a  degree  of  adaptation  to  the  reversal  of  day-night  activity.  It  was,  therefore, 
logical  for  the  airline  to  reduce  the  duty  period  from  two  weeks  to  one;  it  did  this  and  there 
were  no  further  complaints  of  fatigue. 

Space  does  not  allow  further  illustrations.  Similar  methods  were  used  over  a  four  month 
period  with  a  group  of  short  haul  jet  pilots  and  the  importance  shown  of  sleep  patterns  and  duty 
Sequences. 

CONCLUS ION 


To  conclude,  one  can  say  that  there  are  three  main  areas  of  interest  in  aircrew  workloads. 
With  the  first,  the  immediate  workload,  there  is  now  evidence  to  suggest  that  before  long  it  will 
be  possible  to  use  physiological  measurements  to  assess  the  pilot's  level  of  arousal  in  terms  el 

those  which  are  optimal  for  the  particular  flying  task. 

In  the  second,  the  duty-day  workload,  we  do  not  as  yet  have  anything  better  to  use  than  the 

pilot's  subjective  opinion.  One  hopes  that  eventually  a  more  objective  .uvd  quantitative  iremu ic 
might  be  found  and  we  will  continue  with  the  biochemical  approach. 

In  the  third,  long  term  workload,  comparatively  simple  methods  such  as  the  leejn.g  oi  diaries 
by  the  crows  car.  give  much  valuable  information  regarding  the  desirabi  1 1 ty  i»r  olherwisi-  oj 
particular  duty  sequences  and  sleep  patterns. 
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SUMMARY 


The  term  'Work  Load  Study'  can  be  interpreted  in  many  ways  depending  on  one's  particular  interest 
and  point  of  view. 

During  the  past  four  years  a  small  team ,  from  the  Hoard  of  Trade  Aviation  Department  and  the 
Royal  Air  Force  Institute  of  Aviation  Medicine >  has  been  cotulucting  field  studied  in  civil  airlines 
during  both  long-haul  and  short-haul  operations.  The  team  have  found  such  studies  can  be 
conveniently  divided  into  three  main  areas ;  that  associated  with  short  term a  or  instantaneous 
work  load ,  that  associated  with  accumulated  effects  of  work  loads  over  a  particular  period  and 
that  associated  with  the  total  working  environment. 

Some  of  the  methods  used  and  the  indications  for  further  areas  of  research  are  discussed . 
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SUMMARY 

The  energy  eo.t  of  piloting  three  U.  S.  Army  hellcopt-r.  (light,  utility  and  medium)  and  one  utility 
fixed  wing  aircraft  wot  invejtigoted.  Energy  expenditure  wa»  calculated  from  expired  minute  volume  ond  expired 
,  .  i...  .L.I _ i  _ i  in  .vindttlnm,  Doto  were  collected  on  a 

total  of  ilxteen  plloti,  five  of  whom  flew  all  three  helicopter!.  All  of  the  helicopter  pilot*  were  experienced 
te»t  pilot*.  The  data  Indicate  that,  for  the*e  pilot*,  ond  flying  condition*  *tudled  (level  flight  In  good  weather) 
and  aircraft,  the  energy  eo*t  mu*t  be  claued  a*  very  light  work,  averaging  1.79  kcal/mlnute.  The  energy  co*t 
of  flying  the  fixed  wing  aircraft  by  let*  experienced  pilot*  wo*  ilmllor  to  previously  reported  energy  expenditure* 
for  luch  aircraft.  The  data  were  legregated  to  separate  measurement*  made  at  altitude  from  tho*e  made  durlnc 
flight  in  close  proximity  to  the  ground  (take  off,  hover,  etc).  In  three  of  the  four  aircraft,  the  pilot  .  energy 
expenditure  wai  greater  when  ground  contact  wai  possible. 
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IN  ORDER  TO  evaluate  such  fact  on  at  fatigue,  decrement  of  performance,  mon-machine  interactions,  and  thermal 
stress,  a  study  was  conducted  to  accumulate  dota  concerning  the  energy  cost  involved  in  flying  current  Army  air¬ 
craft,  particularly  no i i copters . 

It  is  surprising  that  there  It  to  little  data  on  the  energy  costs  of  flying  when  one  considers  the  wealth  of 
available  information  about  the  energy  costs  of  performing  a  wide  range  of  other  human  activities.  Passmore  and 
Durnln's  comprehensive  review  In  1955  reported  only  two  studies  in  only  one  of  which  were  measurements  mode 
during  flight.  Twelve  years  loter,  these  some  reviewers  had  found  no  new  studies.  As  far  as  we  can  find,  there  is 
no  information  available  about  the  energy  costs  of  flying  helicopters.  Earlier  studies  have  all  been  done  In  fixed 
wing  aircraft.  It  is  generally  accepted  by  dual  rated  pilots  that  rotary  wing  aircraft  are  more  difficult  to  fly  than 
fixed  wing  aircraft.  A.  pilot  ts  always  "flying"  them,  by  continual  adjustments  of  the  cyclic  and  pitch  control 
sticks  and  the  rudders.  It  hat  been  sold  that  flying  helicopters  is  "like  rubbing  your  head,  patting  your  stomach, 
and  tapping  time  to  Dixie  with  both  feet,  all  at  once". 

We  ware  concerned  In  this  initial  study  with  energy  costs  involved  In  flying  light  (OH-6A),  utility 
(UH-1D),  and  medium  helicopters,  and  also  a  typical  utility  fixed  wing  aircraft  (U-6A). 

METHODS 


SUBJECTS.  The  subjects  studied  were  sixteen  men,  all  experienced  aviators.  The  twelve  helicopter 
pilots  fly  test  and  evaluation  missions  for  the  U.  S.  Army  Aviation  Test  Board,  Fort  Ruckor,  Alabama.  The  four 
U-6A  pilots  may  be  considered  as  typical  Army  aviators,  The  mean  age  of  all  pilots  was  39.5+1.4  years;  mean 
nude  weight  was  78.7±2.6  kg;  mean  height  was  176.1  +  1.26  cm;  mean  surface  area  was  l.96±  .04  m3 . 

They  wore  an  overage  clothing  weight  while  flying  of  4.51  +  0.  16  kg.  Their  experience  as  aviotors  may  be 
represented  by  their  mean  flying  time  of  7025  hours,  with  o  range  of  1500  to  13,200  hours. 

MEASUREMENT  PROCEDURE.  Energy  expenditures  were  calculated  from  expiratory  minute  volume  and 
expired  air  oxygen  content  measurements  made  under  basal  conditions  and  during  normal  flight  duties  of  pilots. 

Each  pilot  wore  o  standard  rubber  oxygen  face  mask,  (service  MS22001)  which  covers  the  nose  and  mouth,  fitting 
under  the  chin,  and  which  had  been  modified  to  allow  respiration  through  a  T-shaped  plastic  one-way  breathing 
valve  (Collins  J  catalog  no.  P-307)  attached  to  the  mask.  The  mask  and  J  valve  combination  had  a  dead  air  space 
of  less  than  175  cc.  Each  pilot  was  accustomed  to  wearing  the  mesk  and  could  perform  piloting  tasks  without 
significant  interference  by  the  mask.  Expiratory  minute  volumes  were  calculated  from  total  expired  volume  as 
measured  by  the  Franz  Mueller  gas  meter.  A  0.6%  sample  in  Mueller  bags  was  dried  and  oxygen  percentage 
measured  by  a  paramagnetic  oxygen  anolyzer  (Beckman  Model  E-2).  All  volumes  were  corrected  to  STPD,  based 
on  the  barometric  pressure  measured  by  a  standard  surveyors  field  barometer  carried  within  the  aircraft.  Kilo¬ 
calories  were  calculated  by  the  Weir  formula,  and  surface  orea  was  computed  from  the  nomogram  of  DuBois. 

An  electrocardiograph  was  recorded  from  two  sternal  electrodes  on  the  magnetic  rope  of  an  electro- 
cardiocorder,  from  which  EKG  paper  strips  were  reproduced.  The  number  of  QRS  complexes  during  a  twelve 
second  time  interval  were  counted  for  heart  rate  calculation. 

Basal  measurements  were  made  early  in  the  morning,  ten-twelve  hours  postprandial,  while  the  subjects 
were  lying  quietly  in  a  semi-darkened  room.  During  the  flying  period,  the  first  measurements  were  taken  during  o 
five-minute  rest  period  prior  to  starting  the  aircraft  engine  (sitting).  The  second  measurement  period,  during  hover 
or  taxi  of  the  aircraft,  averaged  four  minutes  in  duration.  The  third  measurement  period  began  at  take-off  and 
lasted  for  approximately  two  minutes  until  the  aircraft  was  leveled  off  at  1500-2000  feet.  A  five-minute  period 
of  level  flight  (level  1),  was  followed  by  a  seven-minute  period  during  which  the  pilot  flew  In  a  typical  holding 
pattern  (aerobatics),  with  measurements  mode  during  the  last  five  minutes.  Level  flight  was  performed  for  another 
five  minutes  (level  2),  and  descent  measurements  began  approximately  two  minutes  before  touchdown  and  were 
continued  until  the  aircraft  landed.  All  values  are  reported  as  the  mean  plus  or  minus  one  stondord  error  of  the  mean. 

RESULTS 


Basal  values  for  metabolism  ond  heart  rate  were  secured  from  fifteen  of  the  men.  Their  mean  V(=  wos 
6.52±  .20  L/minute;  mean  Vq#  was  237  +  0.7  cc/min;  mean  metabolism  was  35.1+  1.6  kcal/m3-hr. 
(1.14±0.04  keal/min);  ond  their  mean  basal  heart  rate  was  61.5+1.6  bpm.  There  is  no  basal  metabolism  data 
for  one  helicopter  pilot,  who  flew  all  three  helicopters,  due  to  technical  problems.  A  repeat  of  this  data  point  wos 
not  possible  owing  to  non-availability  of  the  subject. 

8ecause  some  of  the  pilots  were  scheduled  to  fly  more  than  one  type  of  helicopter  during  the  time  of  the 
study,  data  were  collected  from  five  pilots  who  flew  all  three  helicopters  (Table  I).  The  mean  total  flying  liours 
for  these  five  pilots  was  8,640  (4,000- 1 3,000)  hours,  the  mean  age  wos  40.0+3.3  years;  the  mean  body  surface 
wos  1.93±  0.04  m*.  Their  basal  heart  rate  was  61. 2d  2.5  bpm  and  their  basal  energy  expenditure  (N  =  4)  was 
38. 6 ±  4.4  kcal/m3-hr.  (1.08+  .017  kcol/min). 
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Figure  1  prerent i  o  comparison  of  the  energy  cost  of  handling  these  aircraft  near  the  ground  ond  at 
altitudes  above  500  feet,  for  the  pilots  in  Table  1.  The  data  for  the  measurement  periods  of  hover,  taxi,  take-off 
and  landing  are  used  for  low  altitude  (ground)  operation.  Measurements  during  level  flight  I  and  2,  and 
aerobatics  are  used  for  operation  above  S00  teet  (air).  The  bo  so  I  and  sitting  measurements  are  presented  for 
comparison, 

EMiCuSSiGN 

We  expected  to  find  a  significant  difference  in  the  energy  cost  of  flying  the  three  different  aircraft 
because  of  ths  varying  degree  of  mechanical  complexity  involved.  We  found  no  such  significant  difference. 

We  did  expect  to  find  significant  differences  In  the  energy  cost  of  piloting  the  aircraft  near  to  the  ground 
and  at  a  significant  altitude.  There  expectations  were  realized.  Hovering  of  helicopters  and  taxiing  the  fixed  wing 
aircraft  require  that  the  pilot  provide  frequent  ond  careful  control  motions  to  stabilize  a  dynamically  unstable 
aircraft.  The  greatest  danger  of  catastrophic  ground  contact  oxlsts  during  take-off  and  landing.  The  pilot  must 
maintain  more  precise  control  of  aircraft  under  these  conditions  than  during  operation  at  o  significant  altitude. 

The  measured  energy  expenditures  suggest  that  fixed  wing  aircraft  Impose  a  greater  work  load.  This  may 
result  from  differences  In  pilot  experience  or  weather  (fixed  wing  aircraft  are  more  Influenced  by  surface  winds)  or 
Inherent  differences  between  fixed  and  rotary  wing  aircraft. 

Review  of  the  literature  reveals  that  for  fixed  wing  -aircraft  in  combat  or  routine  flying,  average  energy 
expenditure  are  2.9  kcal/min  and  1.7  cal/min.  These  results,  when  compared  to  our  findings  for  rotary  wing 
aircraft  (average  1.72  kcal/min)  suggest,  at  least  for  experienced  pilots,  that  there  Is  no  gross  difference  in  the 
overall  energy  cost  of  piloting  aircraft. 

Heart  rates  in  general  parallel  the  energy  expenditure  and  at  no  time  were  high  enough  to  suggest  a 
cardiovascular  response  to  emotional  or  physiological  stress.  Neither  the  heart  rotes  nor  energy  expenditures 
measured  in  this  study  suggest  that  under  the  conditions  of  this  study,  the  mechanical  woric  of  piloting  these  aircraft 
Is  a  significant  cause  of  pilot  "fatigue". 

This  study  was  designed  to  measure  tho  energy  cost  of  the  piloting  task  during  actual  flight  and  to  provide 
information  not  presently  available,  particularly  for  helicopters.  We  bolieve  that  the  energy  cost  of  flying  heli¬ 
copters  presented  here  represents  the  minimum  values.  We  suggest  that  the  energy  cost  of  flying  these  aircraft  by 
less  experienced,  or  less  confident  pilots  will  be  significantly  greater.  We  arc  continuing  this  study  in  order  to 
increase  the  variables  of  aircraft  type,  pilots,  and  flight  conditions  studied. 

We  wish  to  express  our  gratitude  to  the  President  of  the  U.  S.  Army  Aviation  Test  Board  and  the  pilots 
of  the  Logistical  Evaluation  Division  who  willingly  cooperated  with  us  on  this  study.  A  special  word  of  thanks  to 
LTC  Robert  J.  T.  Joy,  MC  who  assisted  in  this  study  and  SP5  Lawrence  Kelly  in  preparation  of  this  paper. 
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hy 


R  ■  Douglas  Jones 


Research  Psychologist 
Aviation  Branch 
Systems  Research  Laboratory 
I.J.S.  Army  Human  Engineering  Laboratories 
Aberdeen  Proving  Ground,  Maryland 


SUMMARY 


MUCH  Ob'  TlliC  previous  work  in  thermal  stress  utilized  subjects  performing  heavy  physical  l.ilmr  under 
cunditiobs  of  extremely  high  temperature  ami  Immunity  ■  based  on  the  assumption  that  performance  remains 
"normal"  as  long  as  lx>dy  thermal  equilibrium  is  maintained,  these  eariy  iiivealigaliuns  piuvlbcd  v.im.i',,!,, 
dam  with  respect  to  physiological  adaptation  ami  maximum  tolerance  limes  . 

Unfortunately,  over  the  past  decade,  the  assumption  of  "physiological  adequacy"  and  the  data  supporting  It 
have  become  less  ami  less  relevant  to  tile  problems  of  (|uantlfylng  the  effects  of  less  severe  thermal 
environments  on  complex  human  performance  hi  addition,  the  thermal  stress  literature  reflects  a  wide 
divergence  of  opinion  regarding  the  select  inn-,  intui'pretallon,  and  administration  of  swell  var: '.allies  as  stress 
Indices,  exposure  times,  acclimatization  periods,  etc.  Moreover,  as  a  consequence  of  the  failure  to 
standartlizc  experimental  variables,  there  Is  currently  little  agreement  aiming  researchers  on  either  the 
significance,  magnitude  or  direction  of  performance  change  as  a  function  of  the  thermal  environment. 

The  Increasing  demand  for  design  standards  applicable  to  crew  station  thermal  environments  would  seen, 
to  necessitate  some  modification  of  approach  in  future  thermal  stress  research.  In  gene  ral,  changes  in  the 
basic  research  strategy  should  Include: 

1 ,  Adoption  of  a  standardized  index  representing  all  relevant  environmental  parameters  acting  to 
produce  what  Is  now  loosely  termed  "heat." 

2.  investigation  of  those  thermal  conditions  expected  to  obtain  in  the  predicted  operational 
environment  for  a  given  man -machine  system  (rather  than  those  capable  of  being  produced  only  in  a  climatic 
chamber). 


3.  Greater  emphasis  on  psychological  variables  such  as  learning,  motivation  and  personality  as 
they  interact  with  both  environmental  and  task  variables  . 

4.  A  new  definition  of  "stress"  in  terms  of  changes  hi  a  subject's  ability  to  perform  a  given  task 
rather  than  his  physiological  adaptation  . 

5.  increased  attention  to  the  kinds  of  increasingly  complex  performance  demanded  of  the  human 
operator  in  modern  man -machine  systems  . 


IN  l’)4S  Till-:  British  psychologist  N.  II.  Ma-Ax-orth  initiated  tin-  first  comprehensive,  system, die  investigation 
of  tile  effects  of  thermal  stress  on  psvehonm. or  .  lr.  ills  iIi.il  certain  types  ol  skilled 

ixrioriit.'ince  are  subject  to  degradation  under  selected  conditions  of  Itlgh  ambient  temperature,  Mackworth 
provided  the  first  empirical  refutation  of  what  Connell  ( 1 94h )  later  termed  "The  Conceit  ol  Physiological 
Ado<|iiacy,"  Tills  concept  is  based  on  the  assumption  th.it  behavior  v.-!!!  remain  mo  mol  as  long  as  the  body's 
liiermai  e(|iiil!l>riuni  can  lx;  maintained.  Unfortunately,  altliougii  the  evidence  adduced  for  this  assumption 
derives  almost  exclusively  from  studies  of  heavy  physical  labor  In  extreme  thermal  environments,  it  lias  had 
a  dominant  and  continuing  influence  on  the  methodological  approaeli  to  thermal  stress  re  ...arcli. 

Whether  explicit  or  implicit,  past  reliance  on  the  validity  of  this  assumption  has  tended  to  emphasize  the 
response  characteristics  of  physiological  systems,  often  to  the  exclusion  of  other  potentially  valuable  depen¬ 
dent  variables.  For  example,  today  we  know  a  great  deal  about  tile  adaptive  mechanisms  of  the  cardio-vascular 
system  under  heat  stress;  we  know  very  llale  about  either  the  duration,  magnitude  or  direction  of  changes  in 
an  Individual's  ability  to  perform,  under  heat,  the  increasingly  complex  psychomoror  tasks  associated  with 
piloting  an  ailcraft.  Indeed,  even  when  '^.svehomotor  task"  is  broadly  interpreted  to  mean  a  coordination  of 
sensory,  cognitive  and  motor  processes,  wc  find  that  fewer  then  hi)  thermal  stress  studies  employing  this 
ty|x-  of  performance  have  been  generated  during  the  24  years  following  Muckworth's  work.  Taken  as  a  whole, 
these  studies,  in  addition  to  reflecting  a  sporadic  approach  to  thermal  stress  research,  often  present  directly 
opposed  conclusions  regarding  tile  type  of  performance  change  to  lx-  expected  under  conditions  of  high  ambient 
temperature  .  The  remainder  of  this  paper  is  devoted  to  an  examination  of  some  experimental  variables  whose 
use  and  misuse  have  contributed  to  the  conflicting  reports  in  the  literature,  hi  addition,  criticism  is  coupled, 
wherever  possible,  with  suggestions  for  Improvement  of  future  work.  The  analysis  begins  with  a  brief  review 
of  the  literature  itself. 

THERMAL  STRESa  LITERATURE  -  IN  BRIEF 

THERE  ARE  A  number  of  bibliographies  and  reviews  available  on  tills  subject  (Bell  &  Provins,  J 962 ;  Groth  & 
Lyman,  1963:  Hendler,  1963;  Stevenson  it  Joimsun,  1967;  Stevenson  Si  Trygg,  1966;  U.S.  Army  Tropical  Test 
Center,  1967:  Wing  8i  Touchstone,  1963).  Unfortunately,  despite  their  publication  dates,  none  of  these  coin - 
pilatluiis  are  recent  or  Inclusive  enough  to  allow  an  accurate  anpr.dsai  of  the  effects  of  thermal  stress  on 
complex  "mental"  or  iwyclitimotor  performance.  Tin.-  only  recent  review  in  tliis  area  was  done  by  Wing  (1965). 
He  examined  IS  experiments  in  order  to  determine  the  upper  limits  of  "unimpaired  mental  performance 
Since  his  goal  was  to  plot  performance  decrement  as  a  function  of  exposure  times,  however,  the  experiments 
chosen  were  necessarily  limited  to  those  in  which  some  decrement  was,  in  fact,  reported.  The  major 
objection  to  such  a  procedure  is  that  It  tends  to  ignore  or  minimize  the  existence  of  studies  which  report  no 
change  or,  in  some  instances,  improvements  in  performance.  It  is  important  that  such  divergent  results  be 
clearly  acknowledged  .  Only  then  can  comparisons  lx-  made  with  respect  to  experimental  designs,  apparatus, 
subjects,  etc  .  Such  comparisons  arc  necessary  not  only  in  reconciling  conflicting  data,  but  in  establishing  a 
reliable  basis  for  tile  selection  and/or  control  of  relevant  variables  in  future  work. 

In  comparing  stress  vs.  nonstress  performance  in  a  given  task,  only  three  outcomes  are  possible: 

(1)  improvement,  (2)  decrement,  or  (3)  no  change.  Within  each  of  these  categories,  studies  included  in  the 
present  review  are  further  classified  according  to  the  type  of  performance  investigated.  These  performance 
areas  are  similar  to  those  used  by  Wing  Si  Touchstone  (1963),  and  include  the  following:  (1)  sensory  thresholds 
and  reaction  time,  (2)  vigilance  and  perception,  (3)  psychomotor  performance,  and  (4)  "mental"  performance. 
These  categories  arc  neither  mutually  exclusive  nor  exhaustive;  tiiey  are  primarily  for  convenience  and 
represent  only  one  of  a  number  of  possible  classification  systems.  For  quick  reference,  the  pertinent 
research  is  listed  in  Table  1 . 


SELECTION  OF  VARIABLES  FOR  FUTURE  RESEARCH 

IN  GENERAL,  tile  literature  reviewed  provides  no  clear-cut  criteria  upon  which  to  base  predictions  of  mental 
or  psychomotor  performance  under  thermal  stress  conditions.  The  basic  lack  of  agreement  between  the 
various  studies  is  primarily  the  result  of  a  generalized  failure  to  standardize  experimental  conditions.  The 
use  of  a  wide  variety  of  temperature  levels,  exposure  times,  etc.,  makes  any  direct  comparison  of  results 
difficult.  The  studies  Can,  however,  lx-  profitably  examined  under  flic  following  assumption:  if  the  application 
cf  differing  levels  (or  the  omission)  of  an  experimental  variable  leads  to  conflicting  conclusions  regarding 
performance,  then  the  effects  of  that  variable  must  lx-  controlled  and  accounted  for  in  future  research.  I  have 
summarized  wliat  1  consider  to  he  a  majority  of  such  variables-  in  Tabic  II.  It  is  obvious  from  the  scope  of 
this  table  that  time  and  space  limitations  prohibit  any  detailed  description  of  tlx-  relative  contributions  of 
subject,  task,  and  environmental  variables.  Therefore,  1  would  like  to  focus  at  this  time  on  the  role  of 
environmental  and  physiological  variables  hi  thermal  stress  research. 
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TABLE  I 


Lfl  hRATURh  SUMMARY 


PERFORMANCE 

EXPERIMENTAL  1 

EXPOSURE 

■ 

DIR 

MEASURED 

TEMPERATURES  | 

TIMES 

m 

OF  PERF  1 

CWMSQWV  THQ  FSHQt  nqj 

rv-it  i 

uu _ 

cy  i 

w*m\ 

il 

nu 

&  REACTION  TIMES 

Bulb  °F 

Bulb  °F 

Hrs 

Min 

■ 

+ 

0 

- 

Simple  Reaction  Time 

126 

25-40 

m 

X 

Lovlngood,  ct  al.,  1967 

ii  it 

80 

(ET=86) 

6 

□ 

X 

Reilly  &  Parker,  1967 

Simple  &  Serial  RT 

B6 

86 

100 

6 

E 

X 

Ivy,  et  al .,  1944 

"  " 

117 

85 

17 

6 

8 

X 

u  il 

II  H 

90 

83 

21 

20 

X 

Pace,  et  al .,  1945 

•  I  II 

108 

83 

3 

20 

X 

n  .• 

Serial  RT 

92-104 

2.S 

14 

X 

Peacock,  1956 

Tactile  Sensitivity 

30 

Task  Det 

72 

X 

Russell,  1957 

Serial  RT 

90-95 

i.2 1 

l  . 

m 

X 

Fraser  &  Jackson, 

VIGILANCE  & 
PERCEPTION 

i 

B 

■1 

■ 

Spatial  Orientation 

n 

Visual  Vigilance 

100 

80 

(ET  =86) 

6 

18 

Reilly  8t  Parker,  1967 

Perceptual  Speed 

Q 

Auditory  &  Visual  Vig. 

113 

(ET  =86) 

w 

n 

Poulton,  et  al . ,  1965 

Auditory  Vigilance 

Body  Temp  = 

101°F 

X 

Wilkensnn,  rtnl.,  1964 

Visual  Vigilance 

100-115 

4-24 

A  , 

X 

Loeb,  et  al.,  1956 

ii  n 

104, 122 

1, 2&3 

X 

Carlson,  >961 

Auditory  &  Visual  Vig. 

85-145 

76-117 

1/3-4 

8 

X 

Bell,  et  al,  1964 

Auditory  Discrim . 

95 

70,92 

5  1/2 

10 

X 

Fine,  et  al.,  1960 

Visual  Vigilance 

85 

75 

(ET  79) 

x 

Mackworth,  1946a,b 

Auditory  Vigilance 

(ET79-97) 

X 

1961 

Visual  &  Auditory  Vig. 

(ET31-86) 

X 

Pepler,  1958 

Peripheral  Vision 

105 

95 

(BET  95) 

140 

18 

X 

Burslll,  1958 

PSYCHOMOTOR 

[ _ _ _ zz 

--  ■  ■ 

Rapid  Line  Drawing 

115 

1 

2 

36 

X 

Vaughan,  et  al.,  1968 

Mirror  Tracing 

Wr*st- Finger  Speed 

(ET=86) 

X 

80 

6 

18 

X 

Reilly  &  Parker,  1967 

Hand-Finger  Dexterity 
Muscular  Control,  Eye- 

126 

210 

24 

X 

X 

Lovlngood,  et  al.,  1967 

Hand  Coord,  Pursuit  Si 

100 

80 

(ET  =86) 

6 

18 

X 

Reilly  &  Parker,  1967 

Compensatory  Tracking 

X 

Pursu..  Tracking 

104 

Task  Det 

23 

X 

Russell,  1957 

Arm -Hand  Coord 

126 

210 

24 

m 

jvingood,  et  al.,  1967 

Pursuit  Tracking 

Mackworth,  1945,  1961 

t.  ii 

. ET  81-86  - 

. - 

1 

X 

Pepler,  1953,  1958,  1960 

n  ii 

116 

1 

Ka 

6 

X 

1959 

Simulator  "Piloting" 

Physiol  Det 

4 

s 

X 

Blockley  &  Lyman,  1951 

Time  Sharing,  Target 
Prediction 

100 

80 

(ET  =86) 

6 

18 

1 

Reilly  Si  Parker,  1967 

Rotary  Pursuit  Tracking 

Teichner,  et  al,  1954 

COMPLEX  "MENTAL" 

I 

1— _  _ 

Addition  (no  attempted) 

126 

i^a 

210 

24 

■ 

Lovingood,  ct  al.,  1967 

Anticipatory  Perception, 
Judgment 

80,90,100 

60 

16 

1 

Bartlett,  et  al . ,  1955 

Elec.  Tmg,  Course 

86-92 

80 

Mayo,  1955 

Discrimination 

85-100 

75-90 

(ET76-91) 

9 

■ 

Chiles,  1957 

•i  it 

85-110 

75-90 

1 

10 

X 

1958 

Anagram  Solution 

95 

mmm 

3  1/2 

10 

X 

Fine,  etal,  1960 

5  Digit  Mult , ,  IQ  Test 

109 

1 

4C 

2 

4 

H 

p 

Givoni  &  Rim,  1962 

Discrimination 

Pepler,  1958 

Auditory  Recall 

15 

Wing,  et  al .,  1965 

- 

MM 

No  .Checking  &  Addition 

1 

1 

iPhysiol  Det 

3 

m 

Blockley  81  Lyman,  1950 

Simple  Addition 

,  Body  Temp  =  102°F 

63 

12 

u 

Wilkcnson,  etal.,  1964 

Time  Perception 

1 

J _ 

i _ 

] _ 1 

45 

12 

m 

m 

Fox,  et  al . ,  1967 
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TABLE  i> 

VARIABLES  RELEVANT  TO  STRESS  RESEARCH 


ENVIRONMENTAL 


Tndiccs 

of  Stress 

ET 

Effective 

Temp. 

Effective 

19.23 

ETC 

Temp . 
Corrected 

1932 

HP 

Physio) . 

Effect 

Corrected 

1945 

GET 

Effective 

Temp. 

I94h 

C..I. 

Craig  Index 
of  Strain 
Effective 

1950 

ETR 

Temp.  & 
Radiation 

1950 

IMSR 

Four-Hour 
Sweat  Rate 

1952 

HS1 

Heat  Stress 
Index 

1955 

WBGT 

Wet  Bull) 
Glo.'e  Temp 

1956 

Source* 

of  Stressor 

Climatic  Chamber 

vs . 

Outside  Ambient 

Conditions 

Exposure  Times 

Single  V£.  Repeated 


Continuous  vs . 

Intermittent 


SUBJECT 


Physiological 

Adaptive  System  Responses 
I  lypothalamie  -regulatory 
Metabolic  -endocrinological 
Cardiovascular 
Respiratory 
Heat  Storage 

Acclimatization 

Circadian  Rhythms 


Physical 

Age  Nutritional  State 

Sex  Health  -  Present 

Physique  &  Past  History 

Physical  Condition 


Psychological 

Personality 

Skills  &  Abilities 
Motivation 

Intelligence 

Response  "Set" 

Fatigue 


TASK 


Jypt-" 

Complex  vs.  Simple 

Novel  vs .  Repetitive 

Continuous  vs  .  Discrete 

Validity 

Lab  vs.  Operational  Situation 
(Face  v£.  Construct  Validity) 

Instructions 

Written 

Demonstration 

Verbal 

Learning  Factors 

Feedback  --  Continuous  vs. 
Discrete 

Reinforcement  -- 

Learning  vs .  Performance 
Extrinsic  vs.  Intrinsic 
Methods  of  Administration 
Time,  situation,,  physical 
environment 

Fatigue 

Data  Collection 

Measurement  Scales 

Frequency  of  Measurements 
Performance  Averaging 

Statistics 

Sampling 

Size  -  N  =  ? 

Composition;  random, 
stratified  incidental 
Reliability  --  normative  data 

Interactions 

Single  vs.  multivariate 
predictions 

Potentiation 

.3-4 


ENVIRONMENT  A !  V  ARIABLKS 

INDICES  OF  STRESS.  Much  of  the  controversy  rujuinliiu;  the  effects  ul  thermal  stress  stems  from 
tt  failure  to  c,,.,  I.Lr  "Iiv.il"  mV  ,i  llii ujiIl'a  siimtiiiis.  iieai  stress,  as  experienced  hy  the  hiiniim  organism,  is 
actually  n  result  of  the  body's  Integration  of  the  effects  of  (I )  air  temperature,  (2)  liiiuiidity,  (.1)  air  movement , 
and  (4)  radiant  heat.  As  Millard  (1964)  pointed  nut: 

"A  Comprehensive  index  of  environmental  heat  stress  must  evaluate  the  four  physical 
factors  of  the  thermal  environment  in  the  proportion  to  which  each  will  effect  the 
exchanges  of  heat  hy  radiation,  convection  anil  evaporation  between  the  human  body 
and  its  environment  under  varying  conditions  of  skin  temperature  anil  skin  wetness  (p..))." 

The  developmental  liistory  of  attempts  to  construct  such  an  index  began  with  rl:c  use  of  wet  bulb  temperature 
as  the  single  explanatory  factor  (Bedford,  1961).  The  availability  of  increasingly  accurate  instruments  and 
measurement  techniques,  in  conjunction  with  subjective  reports  of  thermal  comfort,  led  to  the  subsequent 
inclusion  of  the  remaining  three  factors  (dry  bulb  temperature,  air  velocity,  radiant  heat).  Usually,  the 
addition  of  each  new  factor  result  '•!  in  a  newly  titled  index,  and  the  proliferation  of  these  indices  ts  in  part 
responsible  for  some  of  the  difficulty  In  comparing  studies  of  performance  under  heat  stress  .  The  terms 
"hut  or  "lligh  ambient  temperatures"  are  frequently  used  by  experimenters  to  refer  to  only  one  or  two  of 
the  four  components  Involved  In  the  production  of  "stress  Many  authors,  for  example,  report  experimental 
temperatures  in  terms  of  wet  and  dry  bull)  readings  only,  and  give  no  information  about  air  movement.  Some 
studies  list  effective  temperatures  blit  provide  no  wet  or  dry  hull)  figures;  others  report  dry  bulb  temperatures 
only,  without  reference  to  humidity.  With  the  exception  of  joy  (1967),  none  of  the  studies  previously  reviewed 
attempted  to  assess  the  possible  significance  of  radiant  heating  effects.  Because  a  number  of  different 
thermal  stress  indices  are  still  being  employed,  a  chronology  of  their  development  Is  provided  in  Table  11. 

It  should  be  noted  that  these  indices  are  primarily  concerned  with  the  physiological  impact  of  heat  on  man's 
ability  to  worx,  and,  in  cases  where  a  particular  index  value  serves  as  a  limiting  factor  for  performance.  It 
is  generally  physical  performance  wliich  Is  being  referred  to. 

In  examining  the  various  indices  it  becomes  apparent  that  all  are  based,  to  some  extent,  on  the  previously 
described  concept  of  physiological  adequacy.  As  such,  they  are  concerned  with  the  metabolic  heat  loads 
generated  In  various  thermal  environments:  these  loads  are  usually  assessed  indirectly  by  the  measurement 
of  physiological  parameters  including  Ilea  rt  rate,  rectal  and  skin  temperature,  sweat  rate,  etc,  Table  III 
(Yaglou  Ik  Minard,  1957)  provides  an  example  of  the  relationship  between  the  many  Indices  and  one  such 
physiological  measure.  Unfortunately,  correlation  coefficients  of  this  magnitude  are  seldom,  if  ever, 
obtained  between  performance  and  physiological  responses. 


TABLE  III 

CORRELATION  BETWEEN  HEAT  STRESS  INDICES  AND  EVAPORATIVE  SWEAT  RATE 


Index 

Correlation  Coefficient  with  Evaporative- 
Sweat  Loss 

ETR 

.7899 

CET 

.78.')  9 

WBGT 

.7798 

Globe  Temperature 

.7232 

ET  (normal  sc;- -1c) 

.6943 

Dry  Bulb  Temperature 

.  5595 

Wet  Bulb  Temperature 

.4606 

With  reference  to  the  sell  lie.  ui  a  particular  Index  tor  research  In  heat  stress,  the  ASHRAE  Guide  and 
Data  Book  provides  the  following  summary  and  recommendations: 


"There  is  presently  no  one  proven  method  for  combining  all  Of  the  component  heat  loads 
into  a  single  value  that  would  accurately  indicate  tile  degree  of  heat  stress  as  perceived 
by  an  individual  forking  or  resting  in  a  hot  environment.  The  difficulty  lies  in  the 
inability  to  simulate  human  response.  Physical  Instruments  can  accurately  integrate, 
hut  the  human  lx>dy  has  the  ability  to  differentiate  between  component  thermal  effects 
and  to  make  prompt  adaptive  changes  winch  the  instruments  Cannot  do.  Nonetheless, 
each  of  tile  indices  will  supply  valuable  information  on  wlilch  to  Ixisc  an  informed  opinion. 

The  index  or  indices  selected  for  use  should  <|i ■  nentl  upon  the  nature  and  extent  of  the 
problem,  the  equipment  and  facilities  at  liar - .■  ml  the  availability  ol  imrsonnel  trained 
ill  tile  field  nf  thermal  stress  (p .  107)." 

Slnei  tills  advice  is  somewhat  general,  let  me  give  an  example  of  how  one  might  go  about  selecting  a 
-qx-iitlc  stress  index.  In  the  process,  problems  of  selection  criteria  will  Ix-coinc  apparent.  I  have  chosen 
as  an  example  the  WBCT  index  .  In  a  prospective  study,  the  selection  of  tliis  Index  could  lx  suhstuntiated 
as  follows- 

1 .  In  the  presence  of  a  ladiant  heat  load,  the  giuix-  temperature  (GT)  represents  the  balance 
between  heat  gained  by  radiation  and  heat  lost  by  convection:  .11  effect,  it  integrates  radiant  heat,  air 
movement,  and  air  temperature  into  a  single  reading.  This  GT  reading  used  in  conjunction  with  a  WB 
thermometer  takes  into  account  the  four  physical  components  of  the  thermal  environment  without  requiring 
a  se|kirate  measurement  oi  air  movement. 

2.  Field  tests  of  the  WBGT  index  have  proven  it  to  lx-  highly  reliable  in  predicting  decrements  In 
physical  performance,  ill  1954,  Yugloii  Sc  Minard  conducted  tests  on  Marine  trainees  ami  found  the  index 
correlated  well  with  11  numlx-r  of  physiological  measures  taken  during  the  training  exercises  .  Subsequent 
Slimmer  studies  at  test  stations  in  Ail/ one  (dry  heat)  and  Florida  (humid  heat)  confirmed  these  findings. 
Additional  trials  in  1953  at  the  Marine  Corps  recruit  training  depot  (Parris  Island,  South  Carolina)  resulted 
in  the  adoption  of  tile-  WBCiT  index  in  1956  by  the  Training  Command  at  that  installation:  it  replaced  an  index 
then  in  use  which  was  derived  from  air  temperature  and  humidity  alone.  Under  the  new  program,  vigorous 
training  of  new  recruits  (first  three  weeks  of  training)  was  suspended  at  WBGT  readings  of  85°  or  higher: 

at  WBGT  88°  or  above,  vigorous  training  exercises  were  suspended  for  all  recruits.  Despite  hotter  weather 
in  1956,  the  incidence  of  heat  casualties  dropped  to  1/3  ol  'lie  1955  figure.  Jn  1957  the  NAS-NRC  sub- 
cciimnitiee  on  thermal  factors  in  l lie-  environment  included  the  use  of  WBGT  levels  in  controlling  physical 
activity  and  preventing  heat  casualties  at  British  Air  Force  and  Naval  training  centers .  in  I960  tile  Marine 
Corps  ordered  the  use  of  the  WBGT  index  at  nil  liases  where  unacclimatizcd  trainees  undergo  physical 
training  during  hot  weuiher.  Finally,  at  a  conference  held  in  October  1966,  members  representing 
US  Army  Natick  LaN’raturics,  USArmy  Engineer  Research  S;  Development  Lalioratory  (now  US  Army 
Mobility  Equipment  R&D  Center),  and  US  Army  Human  Engineering  Laboratories  agreed  to  adopt  the  W0GT 
index  to  specify  permissible  levels  oi  heat  in  Army  helicopter  crew  stations. 

.'}.  instrumentation  for  obtaining  WBGT  is  relatively  inexpensive  anil  quite  reliable.  The  British 
Army  is  currently  developing  and  testing  .1  prototype  WBGT  meter  which  will  allow  direct  readout  of  the 
single  index  value  (Peters,  1967). 

4.  WBGT  correlates  liighly  with  two  other  indices  currently  in  use,  the  CET  (.9983)  and  the-  ETR 
(.9768),  and  will  thus  provide  Mime  liasis  for  comparing  results  from  the  present  study  with  those  reported 
by  other  investigators . 

Having  selected  an  index,  there  remains  tl-.c  problem  of  specifying  the  values  of  that  index  to  lx-  used  in  the 
experimental  situation,  in  applied  research,  index  values  can  generally  lx-  chosen  on  the  basis  of  those 
which:  (1)  are  reported  in  the  literature  as  correlated  with  and  relevant  to  the  typx-  of  performance  under 
study,  (2)  are  capable  of  being  duplicated  and  controlled  accurately  in  the  laboratory,  (3)  permit  subjects' 
to  perform  for  the  required  times  (do  not  exceed  physiological  tolerance  times),  and  (4)  sample  a  range  broad 
enough  to  allow  some  generalization  to  operational  situations  likely  to  lx-  encountered  in  the  "real  world." 
hi  addition  to  these  four,  a  fifth  criterion  is  necessary  when  selecting  WBGT  levels,  due  to  the  structure  of 
the  index  itself.  The  computational  formula,  WBGT  -  ,7WB+  .2GT  i-  .1DB,  indicates  that  (l)as  long  as  the 
weighted  sum  remains  constant,  any  or  all  of  the  component  WB,  DB  and  GT  values  can  change  without 
changing  the  WBGT  index  number  itself,  and  (2)  any  change  in  the  sum,  however  slight,  will  result  in  a  new 
WBGT  number.  Thus,  criterion  5  states  that  when  selecting  WBGT  levels  for  heat  stress  research,  the 
investigator  must  not  only  know  the  relationslilp  ci  the  index  value  to  the  performance  being  studied,  he  must 
also  justify  iiis  selection  of  tile  particular  combination  of  WB,  DB  and  GT  used  to  generate  that  value. 


I 

i 

I 
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Prospective  WBGT  values,  for  example,  of  85°,  88°,  90°  and  101°  could  be  chosen  on  the  basis  of  the  five 
selection  criteria  as  follows: 

!.  Labor  dory  sr.d  field  Studies  nave  reported  aecrements  In  both  physical  and  psychological 
performance  associated  with  temperatures  in  this  range. 

2  .  WBGT  values  of  85°  and  oo”  have  already  been  widely  adopted  as  upper  thermal  limits  for 
moderate  and  heavy  physical  activity  as  well  as  for  specifying  permissible  crew  static  heat  loads  In  Army 
helicopters.  The  studies  which  provide  evidence  for  adopting  such  values  are  not  directly  applicable  to 
pilot  performance,  but  they  do  suggest  that  85°  and  88°  are  productive  starting  points. 

3.  These  WBGT  values  can  be  accurately  administered  and  controlled  within  most  environmental 
test  chambers  available . 

4.  Previous  research  Indicates  that  no  problems  will  be  met  at  85°  and  88°  with  subjects  (Ss) 
engaged  in  a  2-hour  performance  regimen  involving  little  or  no  physical  labor.  It  is  not  known  at  present 
whether  the  90°  and  101°  conditions  can  be  tolerated  physiologically  for  this  period  of  time.  These  extreme 
values  are  Included:  (a)  to  bracket  the  upper  limits  for  unimpaired  mental  and  psychomotor  performance, 
and  (b)  because  these  temperatures  have  actually  been  recorded  in  helicopter  cockpits  under  summer  flight 
conditions  (Moreland  and  Barnes,  1969). 

5.  Some  data  is  available  for  choosing  values  of  VVB,  DB  and  globe  temperatures  for  each  of  the 
WBGT  levels.  Table  IV  lists  these  values  and  the  source  from  which  they  were  obtained. 


TABLE  IV 


COMPONENT  VALUES  FOR  SELECTED  WBGT  LEVELS 


WBGT 

Component  Values  (UF) 

No. 

WB 

GT 

DB 

Source 

87.00 

73.00 

95.00 

Each  set  of  figures  represents  a  point  on  a  psychrunictric 

85° 

69.00 

123.50 

120.00 

chart  (USAERDL,  1956). 

The  straight  line  connecting  these  points  Is  the  "Outside 

Design  Curve"  adopted  by  the  Army  committee  on  aircraft 
crew  station  thermal  environments  (L'SAIIEL  Memo,  14  Dec  66). 

The  curve  Is  based  on  a  review  of  iligli  temperature  extremes 
in  AR  705-15  and  MIL -STD-2  10A,  with  modifications 
suggested  by  the  Joint  Army-Navy-Air  Force  Manual  (TM-5-7H5) 
and  USAF  Climatic  Center  curves,  hi  essence,  the  curve 
represents  the  probabilities  associated  with  the  joint  occurrence 
of  WB  and  DB  temperatures  during  the  hottest  months,  for  the 
hottest  areas,  worldwide  (McDonald,  1964).  As  such,  it  Includes 
the  highest  values  recorded  in  Viet  Nam  (Natick  Labs,  195.3: 
M.irtorana,  1966). 

.58° 

78.60 

1  14  .40 

100.9(1 

[Fuseli  on  actual  flight  measurements  of  L'.S.  Army  aircraft 
cockpit  temperatures  (Joy,  1907:  MoreSaml  &  Barnes,  1909) 

90" 

88.99 

100.14 

97.00 

01° 

95 . 1 1) 

122,20 

106.70 
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It  can  be  seen  from  my  example  that  a  rigorous  ami  comprehensive  selection  of  WBGT  levels  Is  snmi'nW 
difficult  at  the  present  time.  The  difficulties  arc  dm.,  in  |un,  to  the  fact  that  worldwide  climatic  data  is 
available  for  only  two  of  the  three  WBGT  components;  viz  dry  bulb  and  wet  bulb  temperatures  .  Tills  data 
is  presented  as  probability  curves  for  the  joint  occurrence  of  the  highest  wet  and  dry  bulb  readings,  in  the 
hottest  areas  of  the  world,  during  the  hottest  months  of  the  year.  What  is  needed  to  establish  true  index  values 
for  the  WBGT  scale  Is  an  expanded  set  of  3-varlable  curves  representing  the  highest  values  of  solar  radiation 
which  occur  in  conjunction  with  existing  wet  and  dry  bulb  values  .  Fortunately,  worldwide  solar  radiation  data 
is  currently  being  collected  and,  when  available,  should  measurably  increase  ihc  validity  of  the  WBGT  index. 
Given  comprehensive  solar  radiation  measures,  it  should  be  possible  to  accurately  estimate  (at  a  90-9S% 
confidence  level)  the  highest  ambient  WBGT  values  for  prospective  pllot/altcraft  operating  environments  . 

Once  the  reliability  of  such  estimates  is  established,  it  will,  of  course,  be  necessary  to  determine  the 
correlation  between  outside  ambient  and  Inside  crew  station  thermal  environments.  These  correlations  will, 

In  turn,  permit  the  specification  of  more  realistic  design  parameters  for  crew  station  thermal  environments. 

EXPOSURE  TIMES.  In  addition  to  using  a  variety  of  experimental  temperatures,  Investigators  have 
also  employed  exposure  times  ranging  from  J7  minutes  (Blockley  &  Lyman,  1951)  to  6  1/2  hours  (Reiliy  & 
Parker,  1967).  The  selection  of  exposure  times  lias  been  dictated  by  practical  rather  than  theoretical  or 
empirical  considerations  .  Thus,  at  extremely  high  temperatures  and/or  humidities,  physiological  tolerance 
and  requirements  for  subject  safety  are  the  principal  determinants  for  length  of  exposure .  in  more  moderate 
thermal  environments,  those  known  to  be  physiologically  tolerable  for  specific  times,  exposure  time  is 
determined  by  sucll  factors  as  the  time  required  to  complete  the  assigned  performance  task(s).  Even  these 
relatively  gross  criteria  have  not  been  applied  consistently,  however,  and  the  inability  tu  do  so  stems 
primarily  from  the  failure  of  researchers  to  agree  upon  just  wiiat  constitutes  an  "extreme"  or  a  hioderate" 
thermal  environment .  The  problem  is  further  complicated  by  the  existence  of  such  variables  as  degree  of 
■subject  acclimatization  (discussed  under  subject  variables)  wliich  affects  both  physiological  tolerance  and 
the  ability  to  perform ,  In  general,  conflicting  reports  on  performance  decrement  are  partly  attributable  to: 

1 .  Treating  exposure  time  cs  a  dependent  rather  than  an  Independent  variable ;  i ,c . ,  allowing 
thermal  conditions  to  dictate  the  length  of  time  subjects  remain  and/or  perform  in  a  given  situation.  When 
subjects  are  unable  to  remain  in  one  or  more  oqieriiiicmal  conditions  for  the  prescribed  time,  the  resulting 
information  on  physiological  tolerance,  however  valuable,  is  gained  at  the  expense  of  losing  performance 
data .  An  example  of  this  type  of  loss  occurred  in  the  early  work  of  Viteicr  &  Smith  (1946).  Using  tasks 
simulating  the  civrations  of  naval  plotting  and  chart  room,  they  found  no  adverse  performance  effects  at 
ET's  of  75°  and  8(1°.  At  ET  85°,  ivrformancc  decreased  only  slightly  although  Ss  reported  fecTr.gs  of 
annoyance  and  marked  discomfort .  At  91°  ET,  "Marked  irritability,  dizziness,  visual  blackout  and  nausea 
Ik.-c.-imc  increasingly  common  (p.  107)" :  none  of  die  subjects  were  able  to  complete  the  tasks  .  Wing  (1965) 
noted  lliat  "Physiological  tolerance  limits  for  mop  exposed  to  iiigli  ambient  temperatures  have  Ix-cn  available 
for  nearly  two  decades.  It  lias  long  lx.cn  suspected,  however,  that  human  performance  deteriorates  we): 
lx-dnre  physiological  limits  have  Ivon  reached  (p.  960)."  Experiments  in  which  subjects  arc  unable  to 
complete  the  task(s)  add  little  in  the  way  of  quantitative  evidence  to  support  tills  "suspicion . " 

2  .  Using  equal  exposure  (tolerance)  times  as  a  basis  for  equating  thermal  conditions.  Blockley  & 
Lyman  (1951),  using  temperatures  of  160°,  200°,  and  235°,  RH  40%,  found  little  effect  on  Ss’  performance 
until  5-6  minutes  prior  to  reaching  their  physiological  tolerance  limits.  Pepler  (1959),  in  a  quasi-replication 
of  the  study  found:  "It  was  teclinically  impossible  to  maintain  the  very  liigh  air  temperatures  and  low  humidity 
of  Blockley  and  Lyman  .  It  was  decided,  therefore,  tu  use  a  humid  climate  winch  would  impose  a  stress 
equivalent  to  their  200°F  (93°C)  condition,  as  assessed  by  the  subjects'  average  tolerance  times  (p.  383)." 

The  resultant  "equivalent"  conditions  were  1 16°DD,  10S°WB  .Jid  H10  ft/niln  air  movement.  Pcplc-r  found  that 
decrements  hi  performance  were  much  more  severe,  md  occurred  earlier  in  the’  testing  session.  The 
difference  in  results  is  not  surprising  in  light  of  previous  discission  of  the  components  of  thermal  stress  . 
There  is  at  present  no  empirical  data  io  suggest  that  either  the  qualitative  or  quantitative  (subjective  or 
physiological)  stress  effects  of  these  different  thermal  conditions  can  be  safely  equated. 

3.  Assuming  that  equal  exposure  times  allow  thermal  conditions  of  "equivalent  warmth"  to  act  with 
equal  effect  on  performance  Wing  (1965),  plotting  nerfirmance  decrement  (at  various  levels  of  effective 
temperature)  against  exposure  times,  commented  on  this  problem: 

"Secondly,  because  the  curve  is  plotted  in  terms  of  effective  temperature,  there  is 
the  danger  of  assuming  that  all  tin’  combinations  of  temperature,  humidity  and 
airspeed  which  yield  a  given  cfUelive  temperature  also  produce  the  same  degree  of 
performance  decrement.  Tliis  is  undoubtedly  nut  the  case.  Eventually  performance 
decrements  should  be  separately  determined  for  a  large  manlier  of  combinations  of 
temperature,  huniidiiy  and  a,r  movement  and  reported  in  a  tri-diinensioiial  chart . 

However,  such  volui, lii-ous  data  ire  not  yet  available . .  ,(p.  963)." 
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A  final  factor  Involved  in  selecting  heat  stress  exposure  times  Is  the  lack  of  reliable  Information  regarding 
the  effects  of  (1)  repeated  exposures  to  high  temperatures,  and  (2)  continuous  exposure  to  mild  or  moderate 
tncrmal  environments  for  periods  of  several  months,  Previous  studies  have  controlled  for  such  effects  by 
random  assignment  of  Ss  to  conditions.  This  technique  Is  effective  ns  long  ns  the  effects  of  thermal  stress 
are  assumed  to  be  relatively  transient  and  non -additive . 


SUBJECT  VARIABLES 

A  NUMBER  OF  studies  such  as  that  by  Carlson  (1961)  Indicate  that  the  failure  to  conclusively  demonstrate 
performance  decrement  under  thermal  stress  Is  often  due  to  extreme  Inter -subject  ,'ariablllty .  Carlson 
noted  that:  "Although  each  individual’s  performance  was  consistent,  the  range  of  performance  among  the 
nine  subjects  Was  too  great  to  permit  definitive  unalysls  of  the  influences  (of  heat)  on  vigilance  (p.  10).” 

This  variability  is  the  result  of  diverse  physiological  and  psychological  characteristics  which  each  subject 
brings ,  In  differing  amounts,  to  the  experimental  situation.  Under  the  assumptions  of  random  sampling, 
these  characteristics,  such  as  age,  physical  condition,  intelligence,  etc.,  are  assumed  to  be  equally 
distributed  among  experimental  and  control  groups  .  Frequently,  however,  this  assumption  is  not  met,  and 
researchers  have  often  been  foiced  to  use  whatever  subjects  were  at  hand.  The  acquisition  of  subjects  solely 
on  the  basis  of  availability,  Incidental  sampling  as  Guilford  (1957)  terms  it,  has  severely  limited  the 
generality  of  many  experimental  findings  .  Unfortunately,  the  conditions  which  lead  to  expediency  in  sampling 
are  not  Likely  to  Improve  in  the  near  future .  For  tills  reason,  it  is  vital  that  the  researcher  be  fully  aware 
of  the  role  played  by  subject  variables  In  the  determlnntlon  of  performance .  Given  a  knowledge  of  the 
relevant  variables,  there  Is  an  Increased  probability  that  some  controls  can  be  applied,  perhaps  through 
modifications  of  the  experimental  design  and  procedures,  to  limit  overall  variability  within  groups  . 


PHYSIOLOGICAL  FACTORS 

ADAPTATION  TO  thermal  stress  involves  changes  in  a  number  of  physiological  systems.  For  convenience, 
lliese  changes  are  summarized  in  Table  IV,  prepared  by  Fox  (1965). 

TABLE  V 

ADAPTIVE  CHANGES 


Mechanism  Adaptation 


Sweating 

a 

b 

c 

d 

Cardiovascular 

a 

b 

c 

cl 

u 

Metabolic 

a 

h 

Respiratory 

a 

Heat  Storage- 

a 

b 

Behavioral 

Increased  capacity* 

Quicker  onset* 

Better  distribution  over  body  surface* 

Reduced  salt  content* 

Greater  sldn  blood  flow* 

Quicker  response* 

Blood  flow  closer  to  skin  surface 
Better  distribution  over  body  surface 
Reduction  in  counter-current  blood  vessels 

Lowered  Basal  Metabolic  Rate 
Lowered  energy  cost  for  a  given  task 

Hyperventilation* 

Increased  tolerance  to  higher  body  temperature 
A  lower  resting  body  temperature* 

777 


Indicates  adaptations  for  which  there  is  agreement  regarding  experimental  evidence  gathered  to  date. 
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The  magnitude,  rate,  ami  direction  of  change  have  been  established  fur  such  physiological  measures  as 
heart  ’"ate,  blood  pressure,  respiratory  rale  ami  volume,  body  temperature  (oral  and  rectal)  and  rate  of 
sweating,  Tile  relationship  between  changes  in  these  measures  oh'!  changes  ir.  environ;',,;., lieu!  loads 
depends  largely  nn  the  particular  physiological  mechanism  examined.  Thus,  the  correlation  of  thermal 
Index  values  with  evaporative  sweat  loss  Is  high;  with  rate  of  sweating,  It  Is  low .  Regard  less  of  the  size  of 
the  correlation  coefficients,  however,  most  researchers  have  continued  to  select  levels  of  these  physiological 
measures  to  operationally  deline  thermal  stress.  In  this  definitional  capacity  they  have  licvn  particularly 
useful  hi  setting  thermal  tolerance  limits  for  subject  safely. 

On  the  strength  of  their  correlation  with  changes  in  tilt-  thermal  environment,  numerous  attempts  have  liven 
made  to  relate  ada|itlve  physiological  changes  to  concurrent  variations  in  performance.  There  is  little 
argument  among  researchers  that  some  kind  of  relationship  exists,  but  specifying  tin-  parameters  which 
control  or  mediate  its  effects  has  proven  extremely  difficult  for  a  number  of  reasons; 

1 .  Effects  of  physiological  change  vary  Willi  the  ty|ic  of  performance  being  measured  .  Reliable 
decrements  have  most  successfully  I  teen  demonstrated  for  tasks  requiring  mode  rate  -to -heavy  physical  exer¬ 
tion  .  In  tills  situation,  the  expenditure  of  energy  111  performing  pi  S'  os  an  additional  drain  on  the  already 
overworked  physiological  systems  and  thus  increasingly  augments  the  effects  of  the  thermal  stress  already 
present .  The  picture  Is  not  near  ly  as  clear  with  respect  to  effects  of  heat  on  complex  mental  and  |  .yclio- 
rnolor  (Hirforniance  since,  as  i’eplor  (196U)  |>oiniod  out; 

"Little  or  nothing  Is  known,  however,  of  the  mechanisms  or  causes  underlying 
these  effects  .  Changes  in  performance  have  been  observed  In  the  absence  of 
(Watkins,  1956:  Weiner  Si  llutcliinson,  1945)  or  Independently  of  (Mackworth,  I9SII; 

Peplcr,  1958)  changes  in  the  concomitant  physiological  indices  of  an  effect  of 
warmth,  sucli  as  body  temperature,  or  the  amount  ol  weight  lost  as  sweat  (p.  68)." 

2.  Because  changes  in  physiological  measures  and  changes  hi  performance  have  each  liven  shown  to 
correlate  with  exposure  to  high  temperature,  it  lias  been  assumed  that  they  must  also  correlate  with  each 
other  to  the  same  extent .  Empirical  studies  liavc  found  tius  assumption  untenable  for  many  complex 
performance  tasks'.  Bell,  ctal.  (1964),  for  example,  reviewed  the  relation  between  one  physiological 
response  to  heat  (body  temperature)  and  visual  vigilance.  They  concluded  that: 

"No  consistent  relation,  however,  lias  lven  shown  in  any  of  these  studies  between 
body  temperature  or  changes  in  body  temperature  and  changes  in  ix-rformaiu  e 
under  adverse  environmental  conditions,  except  that  a  rise  in  deep  body  temperature 
and  a  deterioration  in  performance  have  both  been  shown  to  lx-  related  to  the 
environmental  temperature  (p.  2H7)." 

3.  Prediction  uf  performance  decrement  is  relatively  good  at  tile  upper  limits  of  physiological 
adaptation;  i.e.,  performance  decreases  rapidly  cnee  a  subject  begins  to  display  symptoms  of  heat  exhaustion 
or  pyrexia.  As  Hcndler  (1964)  summarized: 

"It  is  obvious  that  performance  and  behavior  oi  the  individual  as  an  operating 
entity  depends  upon  the  functional  status  of  the  parts  that  comprise  the  whole. 

As  indicated  previously,  exposure  of  the  individual  to  environmental  temperature 
extremes  can  result  in  a  "  idc  variety  of  compensatory  changes,  the  overall 
effects  of  which  can  confidently  lx  expected  to  result  in  ]*?rformance  decrement 
when  the  compensation  is  insufficient  (p.  334)." 

Short  of  this  point,  however,  prediction  is  poor,  and  the  actual  sha|X>  of  the  curve  representing  performance 
change  as  a  function  of  physiological  adaptation  is  unknown. 

ACCLIMATIZATION.  A  final  factor  which  must  tx'  considered  under  physiological  adaptation  is  that 
of  acclimatization  which  can  be  broadly  defined  as  the  degree  of  efficiency  of  the  individual’s  combined 
adaptive  mechanisms  in  coping  with  environmental  hear  loads.  More  specifically,  the  classical  picture  of 
acclimatization  is  described  by  box  (1965)  as  follows: 

"The  main  features  arc  a  less  marked  increase  in  heart  rate  while  working, 
lowei  skin  and  deep  bexly  temper  jttirc,  a  greater  production  of  sweat  and, 
subjectively,  a  lessened  sense  of  discomfort  (p.  66)." 
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The  following  summary  presents  some  Important  points  to  be  considered  In  controlling  for  the  effects  of 
acclimatization  In  heat  stress  research: 

1 .  Acclimatization  represents  a  process  of  adaptation  characterized  by  reduced  physiological  strain 
under  thermal  stress  ,  It  Is  operationally  defined  by  specific  physiological  Indices  such  as  sweat  rate,  heart 
rale,  reciai  temperature,  etc.  As  an  aggregate  of  these  separate  measures,  acclimatization  Is  still  subject 
to  the  limitations  described  previously  for  single  physiological  parameters;  It  Is  necessary  in  establishing 
physiological  tolerance  limits,  but  Its  utility  In  predicting  performance  decrement  is  best  under  conditions 
in  which  thermal  stress  approaches  those  limits. 

2.  In  general,  Ss  should  be  acclimatized  under  the  hottest  of  the  experimental  conditions  planned. 
There  Is  some  evidence  tiiat  adaptation  across  climatic  conditions  occurs,  but  the  exact  amount  of  transfer 
has  not  been  established  . 

3.  For  studies  interested  in  measuring  performance  decrement  under  some  standard  operational 
condition  Involving  thermal  stress,  subjects  should  he  brought  to  the  maximum  level  of  acclimatization 
possible  for  two  reasons .  Hirst,  in  most  field  studies  or  studies  simulating  operational  situations,  the 
Interest  is  primarily  In  determining  the  amount  of  performance  degradation  which  occurs  In  spite  of  rather 
than  In  the  absence  of  defenses  against  thermal  stress.  Thus,  prospective  studies  of  pilot  performance 
might  focus  on  the  decrement  which  occurs  even  with  standard  ventilation,  ad  lib,  water  Intake,  and  a  subject 
who  is  fully  acclimatized.  Second,  full  acclimatization  for  Ss  prior  to  performance  testing  avoids  the  type 

of  confounding  reported  by  Wilkinson,  et  al.  ( 1964)  In  their  study  of  heat  effects  on  reaction  time  and 
auditory  vigilance.  They  reported  that  "Results. .  .confirm  the  development  of  heat  acclimatization  over  the 
testing  periods. .  .(p.  2S9)."  This  situation  should  be  avoided  until  such  time  as  data  linking  change  and/or 
rate  of  change  of  adaptation  with  performance  becomes  available  . 

4.  All  Ss  should  be  exposed  to  the  full  acclimatization  training  program  .  A  physical  examination, 
however  thorough,  determines  only  tin-  "normality"  of  a  S's  physiological  adaptive  systems;  it  does  not 
insure  that  these  systems  will  function  adequately  under  extreme  thermal  loads  .  Gold  (1961)  has  noted  this 
problem: 


"The  philosophy  of  judging  heat  tolerance  usually  takes  the  form  of  an  "Index" 
that  seeks  to  express  physiological  strain'  in  terms  of  numbers.  The  greater 
the  nu tnlxj r ,  the  greater  the  strain:  the  lesser  the  number,  the  lesser  the 
strain.  However,  inherent  In  such  a  philosophy  is  the  fallacy  that  the  level  of 
strain  by  itself  can  constitute  an  adequate  evaluation  of  heat  tolerance.  At  this 
laboratory  it  is  felt  that  two  questions  must  first  lie  answered  before  heat 
performance  can  be  properly  evaluated .  Hirst,  to  what  extent  can  an  individual 
dissipate  heat'?  Second,  how  great  a  price  must  he  pay  ?  Indexes  of  strain  cun 
at  best  answer  only  the  second  question,  and,  as  such,  information  obtained 
from  them  is  liable  to  be  quite  misleading  (p.  144)." 


CONCLUSION 

IN  PRESENTING  A  critical  analysis  of  any  Ixxly  of  experimental  data  there  is  always  a  danger  of  overempha¬ 
sizing  the  negative  aspects  .  In  the  case  of  thermal  stress  research  there  are  many  such  aspects,  the  most 
obvious  being  the  radically  divergent  conclusions  regarding  the  effects  of  “heat"  on  performance  .  However, 
rather  than  dwelling  on  the  fact  that  such  a  conflict  exists,  I  have  attempted  instead  to  explain  its  genesis 
In  terms  of  certain  uncontrolled  (or  poorly  controlled)  environmental  and  subject  variables.  In  conclusion, 
let  me  summarize  the  propositions  emphasized  in  tliis  paper: 

1 .  There  is  a  need  to  agree  upon  some  measurement  index  whose  units  would  allow  "thermal  stress" 
to  be  operationally  defined  from  one  experiment  Co  another.  It  may  be  that  a  single  such  index  is  not  possible 
due  to  differing  situational  requirements;  the  attempt,  nevertheless,  should  be  made. 
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2.  It  Is  time  to  question,  experimentally,  the  assumrul™  ri'-o  herr-ir.  perfer mar.c-  -  ui«lu 
concutions  ol  high  amhient  temperature  and  humidity  -  will  •  nain  'hormal"  as  long  as  physiological 
adaptation  is  maintained.  Blocklcv,  rt  al.,  pointed  out  some  time  ago  that: 

" . .  .studies  of  unclothed  men  in  relatively  mild  heat  conditions,  within  the 
climatic  range ,  have  shown  that  the  ability  to  perform  even  simple  tasks  is 
Impaired  long  before  the  danger  of  physiological  collapse  Is  apparent. 

Basically,  the  assessment  ol  hotly  heat  storage  Is  predictive  of  the  physiological 
tolerance  of  men:  it  Is  much  more  difficult  to  predict  tin;  way  In  which 
performance  will  he  affected  by  the  discomfort  which  accompanies  even  a 
perfect  physiological  adjustment  to  heat  stress.  Psychological  considerations 
become  of  supreme  Importance  in  this  mild  heat  area."  |p.  G-l)  (italics  mine) 

3.  The  demands  made  on  operators  in  modern  man -machine  systems  arc  becoming  increasingly 
complex.  With  respect  to  thermal  stress,  it  is  necessary  not  only  to  investigate  the  psychological 
considerations  (motivation,  learning,  etc.)  mentioned  above,  hut  to  examine  their  effects  on  mure  complex 
types  of  performance  involving  such  functions  as  perception,  decision  nuking,  memory,  etc  . 
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Studies  on  Subjective  Assessment  of  Workload  and  Physiological  Change 
of  the  Pilot  During  Let-Down,  Approach  and  Landing 
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Flight  Lieutenant  R.G,  Borland 
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Famborough,  Hampshire,  United  Kingdom. 


and 

Captain  L.E.  Hill 

British  Overseas  Airways  Corporation, 
Hounslow,  Middlesex,  United  Kingdom, 


Subjective  assessment  of  workload  and  changes  in  the  rr  Interval  and  finger  tremor  of  the 
pilot  have  been  studied  during  the  let-down,  approach  and  landing  of  a  Boeing  707  aircraft.  The 
observations  have  been  made  during  thirty-four  landings  into  international  airports. 

Each  let-down  was  assessed  for  its  overall  difficulty  and  with  reference  to  the  various 
factors  which  influenoe  the  work  pattern.  Each  assessment  was  made  by  means  of  the  10  cm  line 
technique.  In  the  case  of  overall  difficulty  of  the  let-down  the  extremes  of  the  assessment  were 
"Extremely  Difficult”  and  "No  Difficulty"  while  in  the  individual  factors  ths  extremes  were  "Very 
Favourable"  and  "Very  Unfavourable".  The  pilot  wae  required  to  indicate  his  assessment  by  a  single 
line  crossing  the  10  cm  line  and  the  assessment  was  quantified  by  the  measurement  of  the  inter¬ 
section  from  the  mid-point  of  the  line.  The  individual  factors  influencing  the  let-down,  approach 
and  landing  were: 

a.  Aircraft  rlt'n  reference  to  technical  serviceability,  efficiency  of  the  crew  and 
problems  associated  with  the  passengers. 

b.  The  availability  of  navigational  aids  during  the  let-down,  approach  and  landing. 

c.  The  meteorological  condltlono  with  particular  reference  to  oelling  and  visibility, 
turbulence  and  conditions  affecting  the  landing  such  as  rain,  snow  and  cross  winds. 

d.  The  physical  features  of  the  airport  with  regard  to  the  length  and  condition  of  thu 
runway,  the  lighting  in  the  event  of  a  night  landing  and  the  existence  of  hrgh  ground. 

e.  The  efficiency  of  the  Control  procedures  with  reference  to  the  air  traffic  control, 
communications,  traffic  and  tower. 

The  rr  interval  was  recorded  during  the  terminal  part  of  cruise  and  the  let-down  and  the 
finger  tremor  was  recorded  before  take-off  -cid  within  one  minute  of  touch-down. 

The  physiological  change  in  the  pilot  associated  with  an  ureventful  let-down  was  a  mean  rr 
interval  between  400  and  450  msec  and  a  finger  tremor  between  0.3  and  0.8  mseo'^gj-l  at  the  10H& 
f  requency. 

During  let-downs  in  which  poor  control  was  often  accompanied  by  inadequate  aids  anc  unfavour¬ 
able  meteorology  and  frequently  preceded  by  a  high  workload  cruise  (indicated  by  a  mean  rr  interval 
at  end  of  cruise  of  less  than  630  msec)  tho  mean  rr  interval  at  touch-down  was  less  than  400  msec 
but  the  finger  tremor  at  10Hz  remained  within  the  range  for  an  uneventful  let-down. 

In  the  event  of  an  unresolved  problem  persisting  or  a  fresh  problem  of  some  magnitude 
appearing  during  the  approach  mean  rr  intervals  of  less  than  400  msec  were  accompanied  by  finger 
tremors  between  0.8  and  1.3  mseo'^Ez”^  at  the  1 0Hz  frequency. 

It  is  considered  that  mean  rr  Interval  around  touch-down  refleots  the  workload  of  the  cruise, 
let-down,  approach  and  landing  whereas  changes  in  finger  tremor  are  associated  with  untoward 
events  during  the  approach. 
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OPERATIONAL  MEASURES  OF  PILOT  PERFORMANCE  DURING 
FINAL  ATP  ROACH  TO  CARRIER  LANDING 


by 


Clyde  A.  Brlctson 


Dunlap  and  Associated,  Inc. 


SUMMARY 


Measure*  of  pilot  performance  during  night  carrier  landings  were  found  to 
differ  statistically  and  practically  from  daytime  performance  In  terms  of 
altitude  control.  Night  approaches  were  characterized  by  more  altitude 
variability ,  a  larger  percentage  of  approaches  belcw  glide  elope  and  higher 
bolter  rateG  compared  with  day  approaches  flown  by  the  same  pilots.  Practical 
application  of  the  performance  data  is  discussed  in  terms  of  pilot  and  LSO 
training,  visual  landing  aids  and  aviation  safety,  Empirical  landing  per¬ 
formance  criteria  arc  developed  from  the  data  and  used  to  predict  :he 
probability  of  landing  success  as  a  function  of  deviations  In  final  approach 
performance. 


OPERATIONAL  MEASURES  OF  PILOT  PERFORMANCf  DURING 
FINAL  APPROACH  TO  CARRIER  LANDING1 

Clyde  A*  oticluou 

Dunlap  and  Associates,  Inc. 

FINAL  APPROACH  TO  landing  has  always  been  a 
critical  phase  of  flight#  Historically,  the 
greatest  number  of  aircraft  accidents  has  occurred 
during  final  approach  and  landing  (Eldridge,  1961). 
Change  the  landing  field  to  an  aircraft  carrier 
deck,  move  the  carrier  through  the  water  at 
30  knots,  oscillate  the  deck  in  three  additional 
deg'ees  of  freedom  simultaneously  (pitch,  roll, 
and  heave),  add  a  black  night,  and  final  approach 
to  landing  takes  on  dimensions  unknown  to  land 
based  pilots.  In  the  fleet,  pilots  typically 
accomplish  daytime  carrier  landing  in  routine 
fashion.  At  night,  with  an  Impoverished  visual 
field,  the  landing  accident  rate  increases  four¬ 
fold. 

PREVIOUS  RESEARCH 

A  good  deal  of  information  about  carrier  landing 
performance  has  been  reported  in  the  last  three 
years.  The  information  was  generated  during  a 
research  project  which  developed  a  rationale  to 
evaluate  visual  landing  aids  for  night  carrier 
recovery.  The  first  project  report  (Winterberg, 
Brictson,  &  Wulfeck,  1964)  analyzed  the  system 
in  terms  of  its  components  and  concluded  that  no 
objective  measure  existed  to  assess  the  quality  of 
a  final  approach  and  landing.  It  also  recomnended 
that  objective  performance  criteria  be  developed 
to  evaluate  the  wide  range  of  performance  that 
exists  between  a  successful  and  unsuccessful 
recovery.  A  second  report  (Brictson,  1966) 
described  successful  application  of  an  objective 
measurement  scheme  to  record  day  and  r.ight  final 
approach  performance  and  suggested  that  additional 
data  be  collected  to  serve  as  a  basis  for  develop¬ 
ment  of  empirical  landing  performance  criteria.  A 
third  report  (Brictson,  Hagen,  &  Wulfeck,  1967) 
documented  pilot  landing  performance  during  com¬ 
bat  operations  in  the  Gulf  of  Tonkivi. 

THE  CARRIER  LANDING  SYSTEM 

We  have  defined  the  carrier  landing  system  in  terms 
of  a  carrier,  aircraft,  pilot,  landing  signal 
officer  (LSO) ,  and  the  environment  in  which  the 
system  operates.  Carriers  can  be  classed  as  either 
small  or  large;  the  length  of  the  angled  deck 
(landing  platform)  can  range  from  520'  to  724' 
in  length.  There  are,  at  present,  seven  different 
carrier-based  aircraft  types,  each  with  its  own 
slow  speed  Handling  and  maneuverability  charac¬ 
teristics.  They  range  from  small  attack  aircraft 
(A4)  to  fighters  (F4,  F8),  bombers  (A5,  A6 ,  A7) 
and  "tankers"  (A'l).  The  pLlots  who  fly  the  Jets 
are  characterized  by  different  levels  of  experi¬ 
ence  in  total  flight  hours  and  in  number  of  day 
and  night  carrier  landings.  Pilot  experience  runs 
from  initial  carrier  landing  qualifications  by  so- 
called  "nuggets"  or  inexperienced  pilots  to  two 
tours  of  combat  exposure  with  several  hundred 
night  recoveries  by  experienced  pilots.  The  LSOs 
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who  monitor  final  approach  performance  can  aleo 
be  differentiated  by  varying  amounts  of  experi¬ 
ence.  Finally,  the  environment  in  which  the 
system  operates  is  a  function  of  weather. .. cioud 
cover,  sea  state,  celling,  visibility,  wind-over¬ 
deck,  and  the  availability  and  degree  of  visibi¬ 
lity  of  such  natural  phenomena  as  the  horizon, 
the  sun,  and  the  moon  including  its  phase. 

VISUAL  CUES 

Fundamental  to  effective  carrier  landing  opera¬ 
tions  are  the  natural  and  artificial  visual  cues 
available  to  the  pilot  during  final  approach  to 
recovery.  During  the  day,  under  normal  condi¬ 
tions,  a  pilot  has  an  abundance  of  natural  visual 
cues  which  provide  information  on  the  "goodness" 
of  his  final  approach  to  landing.  He  uses  the 
horizon  and  the  aircraft  nose  geometry  for 
attitude  information  and  estimation  of  touchdown 
point;  aircraft,  ship,  horizon  geometry  and 
surface  texture  of  the  sea  with  ship's  wake  for 
altitude  control  information;  a  three-dimensional 
view  of  the  ship  for  additional  relative  altitude 
and  speed  of  closure  information;  and  the  painted 
runway  centerline  for  alignment  Information. 
Expansion  patterns  and  peripheral  streaming  may 
also  provide  feedback  on  his  final  approach  per¬ 
formance.  The  pilot's  use  of  natural  and  arti¬ 
ficial  visual  cues  during  final  approach  is 
discussed  more  fully  in  Winterberg,  Brictson 
and  Wulfeck  (1964), 

At  night,  in  dark  and  somewhat  hostile  visual 
surroundings  which  at  best  deteriorate,  and  at 
worst  eliminate,  most  natural  visual  cues,  the 
pilot  is  forced  to  rely  almost  exclusively  on 
artificial  cues  provided  by  visual  landing  aids. 
For  example,  the  natural  horizon  may  be  unavail¬ 
able  up  to  30  percent  of  the  time;  information 
iron  the  surface  texture  of  the  sea  or  the  ship's 
wake  may  be  gone;  and  the  three-dimensional  view 
of  the  ship  may  be  occluded  by  darkness.  In  the 
absence  of  those  natural  visual  cues,  the  pilot 
uses  information  provided  by  visual  landing  aids. 
The  Fresnel  lens,  which  projects  glide  slope 
information  in  the  form  of  a  lighted  "meatball" 
image,  is  used  by  the  pilot  to  estimate  his  rela¬ 
tive  position  un  glide  slope;  centerline  strobe 
lights  and  drop  lights  are  used  for  lineup  infor¬ 
mation;  and  the  angle-of-at tack  index  (inside 
the  cockpit)  is  used  for  speed  information.  The 
pilot  scans  the  visual  field  for  feedback  on  the 
quality  of  his  final  approach  performance,  obtains 
information  from  the  visual  landing  aids  (and 
LSO),  and  makes  appropriate  control  inputs  to 
e fleet  a  safe  recovery. 

Visual  landing  aids  are  therefore  a  fundamental 
and  a  critical  part  of  the  carrier  landing  sys¬ 
tem.  They  provide  the  artificial  visual  cues 
that  tlse  pilot  uses  to  judge  the  adequacy  of 
his  final  approach  performance ...  and  they  are 
especially  critical  at  night. 

What  influence  do  day  and  night  visual  cues  have 
on  fLnal  approach  performance?  Does  landing 
performance  differ  day  and  night7  Can  the  dif¬ 
ferences  be  quantified?  What  happens  to  re¬ 
covery  performance  when  the  deck  is  pitching? 

How  does  pilot  experience  influence  landing  per¬ 
formance?  By  measuring  ami  statistically  de¬ 
fining  empirical  samples  of  final  approach  per¬ 
formance,  operational  answers  to  those  questions 
have  been  provided. 


Three  years  of  human  factors  research  on  carrier 
landing  sy-tem  performance  In  day  and  night 
environments  Is  synthesized  and  reviewed  In  this 
article. 

METHOD 

SUBJECTS.  All  ii. «.  Navy  pilots 

drawn  from  fleet  squadrons.  They  ranked  from 
Ens.  to  Coranander  in  each  squadron  sampled. 

Three  levels  of  pilot  experience  were  defined! 
Inexperienced  pilots,  fleet  experienced  pilots 
and  combat  ready  pilots.  In  the  combat  sample 
105  pilots  averaged  slightly  over  100  combat 
missions  with  an  average  across  squadrons  of 
282  carrier  landings.  A  characteristic  profile 
of  fleet  experienced  pilots  Is  reflected  by  F4 
pilot  background  data  showing  that  the  typical 
pilot  averaged  72  day  and  22  night  carrier 
landings  in  the  F4  nLccraft.  Inexperienced 
pilots,  as  reflected  by  F8  pilots,  had  no  pre¬ 
vious  carrier  landing  experience  in  that  type 
aircraft. 

SAMPLE  SIZE.  A  total  of  1876  final  approaches 
were  recorded  across  six  types  of  Jet  aircraft. 

The  total  is  broken  down  into  1268  day  and  608 
night  landings  which  were  obtained  during  five 
data  collection  tours  aboard  four  aircraft 
carriers.  The  F4  sample,  which  is  used  most 
extensively  to  Illustrate  approach  performance 
trends,  is  based  on  136  day  and  83  night 
approaches  collected  aboard  two  attack  aircraft 
carriers.  Combat  landing  operations  described 
later  aru  based  on  912  day  and  390  night 
approaches  aboard  one  carrier  operating  off 
North  Vietnam. 

SYSTEM  VARIABLES.  All  performance  data  were 
collected  aboard  Large  so-called  super  carriers 
and  included  the  USS  Kilty  Hawk,  USS  Constellation 
USS  Enterprise  and  USS  Ranger.  A3,  A4 ,  A5 ,  A6 , 

F4  and  F8  jet  aircraft  were  used  for  data  collec¬ 
tion.  Visual  landing  aids  included:  the  Fresnel 
lens  optical  landing  aid  (line  and  point  stabi¬ 
lized);  centerline  strobe  lights  and  drop  lights; 
and  white  and  red  floodlights.  Weather  condi¬ 
tions,  except  where  noted  (pitching  deck),  were 
considered  relatively  ideal;  calm  sea,  visible 
horizon,  and  acceptable  ceiling  and  visibility. 

INSTRUMENTATION.  The  procedure  for  recording 
final  approach  performance  has  been  described 
by  Brictson  (1966).  It  consisted  of  a  shipboard 
instrumentation  system  (SPN-10)  which  recorded 
in-flight  geometry  of  aircraft  during  final 
approach  to  landing.  Twin  precision  radars 
locked  on  and  tracked  tin:  aircraft.  The  data 
were  processed  through  a  signal  data  recorder 
which  provided  up  co  eight  channels  of  continuous 
flight  information.  Thu  tracking  radar  was 
calibrated  against  a  known  standard  prior  to 
shipboard  recording  and  was  checked  periodically 
throughout  the  operations  at  sea.  In  a  technical 
description  of  the  system,  Shuh,  Rupp  and  Ames 
(1962)  reported  the  radar  range  error  as  4  feet 
and  angular  error  as  0.3  mi  111  radians.  The 
signal  data  recorder  was  a  military  version  of 
an  eighr  channel  Offner  dynograph  and  provided 
a  continuous  curvilinear  electric  record  of 
aircraft  final  approach  variables.  Recorder 
calibration  was  performed  prior  co  data  collec¬ 
tion  and  the  calibration  for  each  channel  was 
checked  before  each  landing  sequence.  A  paper 
take-up  speed  of  5  mm,  per  second  was  maintained 
for  all  recordings.  Range,  true  altitude. 


altitude  error,  lateral  error,  sink  speed,  true 
air  speed,  deck  pitch  and  closing  speed  were  the 
variables  usually  recorded. 

RESULTS 

MEASURES  OF  APPROACH  PERFORMANCE.  Measures 
ui  day  and  night  carrier  approach  performance 
included  the  following  system  variables: 

Altitude  Error  from  Glide  Slope 
Lateral  Error  from  Centerline 
Sink  Speed  at  the  Ramp 
Approach  Speed  at  the  Ramp 
Arrestment  Wire 
Boarding  Rate 
Bolter  Race 

ALTITUDE  ERROR.  Measures  of  altitude  error 
from  a  prescribed  final  approach  glide  slope  of 
3.5°  wire  taken  aL  four  ranges  from  touchdown. 

Day  and  night  altitude  error  envelopes  are 
illustrated  in  Figure  i.  The  envelope  dimen¬ 
sions  are  defined  by  i2  standard  deviations 
from  mean  performance  for  successful  recoveries. 

In  comparing  day  and  night  altitude  error 
performance  several  things  seem  clear.  First 
of  all,  greater  variability  was  found  in  control 
of  altitude  error  at  night.  Night  approaches 
show  increased  altitude  performance  dispersion 
at  each  range  from  touchdown. 

Previously  published  results  (Brictson,  1966) 
reported  statistically  significant  differences 
between  day  and  night  altitude  control  at 
\  (p  <  .01)  and  1/8  (p  <  .05)  miles  from  touch¬ 
down.  Furthermore,  pilots  also  were  found  to 
be  relatively  consistent  in  their  day  and  night 
altitude  performance  as  reflected  by  reliability 
,correlations •  At  the  ramp,  altitude  performance 
correlated  .78  by  day  and  .21  at  night. 

Second,  a  greater  percentage  of  aircraft  flew 
below  glide  slope  at  night  chan  during  the  day 
recoveries.  At  night,  30%  of  the  F4s  were  below 
glide  slope  at  1/8  mile  from  touchdown;  during 
the  day,  with  the  same  pilot  sample,  only  9  per¬ 
cent  approached  below  glide  slope.  The  tendency 
to  fly  below  glide  slope  with  greater  frequency 
at  night  has  been  found  in  other  data  samples  as 
well  and  is  illustrated  in  Figure  2. 

Finally,  the  night  bolter  rate  (touching  the 
deck  without  arrestment)  was  found  to  be  approxi¬ 
mately  double  the  day  rate  for  F4  aircraft. 

Pilots  had  a  greater  tendency  to  land  farther 
up  the  deck  at  night  and  consequently  had  higher 
bolter  rates  compared  to  their  day  approaches 
(see  Figure  5). 

In  summary,  night  altitude  control  perform¬ 
ance  was  found  to  differ  statistical ly  and 
practically  from  daytime  performance.  Night 
approaches  were  characterized  by  more  altitude 
variability,  a  larger  percentage  of  approaches 
below  glide  slope  and  higher  bolter  rates  com¬ 
pared  with  day  approaches  flown  by  the  same 
pilots . 

LATERAL  ERROR.  Lateral  error  from  center- 
line  was  also  measured  at  four  ranges  from 
touchdown.  Mean  performance  *2  standard  devia¬ 
tions  for  successful  recoveries  are  shown  lu 
Figure  3.  Reliability  correlations  fur  pilot 
lateral  error  at  the  ramp  were  .7^  duy  and 


.69  night  which  reflect  a  relative  consistency  in 
performance.  No  practical  or  statistical  differ¬ 
ences  were  found  in  u«iy  ami  night  iatcrai  error. 

F4  lateral  error  performance  was  found  to  be 
essentially  the  same  for  both  day  and  night  final 
approaches. 

OTHER  PERFORMANCE  MEASURES.  Sink  speed  or 
vertical  speed  was  measured  at  the  ramp  just  prior 
to  touchdown.  Data  from  a  study  of  combat  landing 
operations  arc  graphically  displayed  in  Figure  4. 
For  five  different  jet  aircraft  covering  over 
1300  day  and  night  approaches,  no  significant  or 
practical  differences  were  found  between  day  and 
night  sink  speeds. 

Final  approach  airspeed  was  recorded  at  the 
romp  for  the  same  Jet  aircraft  during  recovery 
operations  following  combat  sorties.  The  data 
were  analyzed  and  no  practical  or  statistically 
significant  differences  were  found  between  day  and 
night  approach  speeds. 

Day  and  night  wire  arrestment  data  for  F4 
aircraft  were  calculated  and  evaluated  for  trend 
information.  With  four  wires  available  to  arrest 
approaching  aircraft  there  wus  a  tendency  for  a 
greater  percentage  of  aircraft  to  land  shorter 
(//]  and  If 2  wires)  by  day  and  longer  (#3  and  //4 
wires  plus  more  bolters)  by  night  (see  Figure  5). 

APPROACH  PERFORMANCE  UNDER  PITCH  I NU  DECKS . 
Fleet  doctrine  calls  for  pilots  to  fly  a  constant 
glide  slope  during  final  approach  and  this  is 
especially  stressed  when  seas  arc*  high  and  the 
carrier  deck  is  pitching.  What  are  the  opera¬ 
tional  consequences  of  a  pitching  deck?  During 
one  data  collection  trip,  heavy  seas  causing 
considerable  deck  motion  provided  the  opportunity 
to  record  approach  performance  under  a  pitching 
deck  condition. 

A  pitching  deck  was  operationally  defined  a .*> 
deck  motion  that  exceeded  feet  (deck  up  or 
down)  from  a  stable  platform.  Thus,  high  deck 
pitch  was  defined  as  any  deck  movement  which 
exceeded  four  feet  either  up  or  down.  Low  deck 
pitch  was  deck  movement  less  than  four  feet. 

Effects  of  high  and  low  deck  pitch  on  day 
and  night  approaches  are  shewn  in  Figure  6  which 
compares  landing  effectiveness  by  contrasting  the 
percentage  of  unsuccessful  approaches  under  low 
and  under  high  deck  pitch  conditions.  Seventy 
percent  of  the  night  recoveries  under  high  deck 
pitch  were  unsuccessful  (bolters  or  wave  offs). 

Ln  sharp  contrast  only  18%  of  the  day  approaches 
were  unsuccessful  under  high  deck  pitch.. 

Previous  data  indicates  that  during  the  day 
under  calm  seas,  pilots  fly  consistently  above 
glide  slope.  When  the  deck  is  pitching  they  'end 
to  fly  even  higher.  At  night,  vhen  the  pilot  Is 
apparently  unable  to  perceive  deck  motion,  the 
percentage  of  unsuccessful  approaches  was  found 
to  Increase  more  radically  (18Z  to  70%)  than  with 
any  other  day/night  recovery  condition  recorded 
to  date. 

INITIAL  CARRIER  APPROACH  PERFORMANCE.  How 
do  pilots  perform  during  their  first  attempts  to 
land  aboard  an  aircraft  carrier?  To  answer  this 
question,  data  were  collected  or.  a  small  sample 
(N  38  58  night;  2  3  day)  of  F8  replacement  pilots. 
Again,  primary*  interest  was  focussed  on  the 
variability  of  altitude  error  control  performance 


—  In  this  case  for  pilots  making  their  initial 
carrier  landings  at  sea. 

A  summary  of  day  and  night  altitude  error 
performance  at  three  ranges  from  touchdown  13 
presented  in  Figure  7.  Performance  data  ware- 
grouped  and  used  to  develop  altitude  performance 
envelopes.  Day  and  night  envelopes  were  based 
only  on  approaches  which  resulted  in  successful 
landings  with  the  dimensions  defined  by  mean 
allltude  error  ±2  standard  deviations. 

In  interpreting  the  envelope  dimensions  it 
is  useful  to  recall  the  F4  data  from  Figure  1. 
Mocice  that  night  altitude  error  dimensions  for 
"inexperienced"  F8  pilots  are  approximately  the 
same  as  those  for  "experienced"  F4  pilots 
(Figure  1).  Although  different  aircraft  types 
should  not  be  compared  directly  because  of 
obvious  differences  in  handling  and  maneuver¬ 
ability  characteristics,  it  appears  that  with 
experience,  pilots  ore  able  to  reduce  the 
variability  of  day  altitude  do rformance.  On  the 
other  hand,  night  altitude  variability,  especially 
in  the  critical  region  below  glide  slope,  remains 
almost  constant  regardless  of  experience.  The 
relative  frequency  of  low  night  approaches  also 
appears  to  be  consistent  across  aircraft  types 
regardless  of  pilot  expet  fence . 

The  percentage  of  KB  aircraft  below  glide 
slope  at  1/8  mile  was  38%  at  night  compared  to 
only  19 %  by  day.  In  general,  at  night  as  the 
percentage  of  F8  ai remit  below  glide  slope 
increased,  unsuccessful  approaches  (bolters, 
wave  offs)  increased  and  overall  hoarding  rate 
decreased . 

EMPIRICAL  PERFORMANCE  CRITERIA.  How  high 
or  low,  left  or  right,  can  an  aircraft  be  at 
various  ranges  from  touchdown  and  still  land 
successfully?  To  answer  that  question  data  for 
successful  carrier  approaches,  u.g.,  those  that 
resulted  in  safe  arrestment  aboard  ship,  were 
used  to  develop  performance  envelopes  in  both 
veitlcal  (altitude)  and  horizontal  (lateral) 
dimensions.  Hie  dimensions  of  the  performance 
envelopes  were  defined  by  1 1»>  (68 Z)  and  ±2o 
(95%)  values  from  mean  perfuiii.  met* •  Separate 
envelopes  were  developed  for  both  day  and  night 
successful  approaches.  Figure  H  compares  F4  day 
and  night  criterion  envelopes  (m  ±  2c). 

Those  envoi  opus  constitute  empirical  pur- 
formnnet  criteria.  Tiny  are  based  on  successful 
F4  landings  aboard  large  carriers,  by  experienced 
pilots,  under  relatively  good  environmental 
conditions  (calm  seas,  gaud  visibility,  distinct 
horizon,  steady  deck). 

The  altitude  performance  envelope  for  the 
F4  is  illustrated  and  compared  with  the  Fresnel 
lens  ideal  altitude  tolerances  In  Figure  9.  In 
reality,  very  few  aircraft  (■r>Z)  fly  within  tin* 
rest  tided  Fresnel  crdcrlun  envelope. 

I’RPBAHl  1.1  TV  OF  SUCCESS FLL  RECOVERY.  h’iuL 
happens  if  „i tv  raft  exceed  the  eiipflitul  per¬ 
formance  criteria?  b'b:il  difference  does  it  make 
In  terms  of  I  and  lug  success  ii  ais  a  i  rcr.i  IT. 
approach  falls  outside  (In  env.  lope;  To 

examine  the  piedictlv.-  uLllilv  ol  tin-  empirically 
derived  performance  envelope*;  "iiiimh  <  r.i;sl  id" 
approaches  were  super  imposed  on  the  "s  ums.s  i  u  1" 
per fon'Miiee  envelopes.  Both  *  I-;  (08/)  and  i?  1 
(95%)  envelopes  arc  shown  In  Figure  10.  A  range 


of  1/8  mile  from  touchdown  wag  selected  as  a 
critical  ooint  at  which  an  aircraft  should  be 
final}*  established  on  glide  slope,  line-up  and 
speed  to  land  eal'eLy.  One-eighth  mile  la 
approximately  eight  seconds  from  touchdown  in  an 
K4  aircraft*  From  the  requiting  houUl  plul*. 
the  probability  of  successful  recovery  for  extreme 
performance  dc  via  tic  a  (>2o)  war.  determined, 

The  probability  of  successful  rerovo  ry,  if 
an  aircraft  approached  outnlde  the  t2o  empirical 
envelope,  is  shown  in  Figure  11.  During  the  day, 
with  experienced  pilots,  there  was  a  high  proba¬ 
bility  u L  landing  success  If  an  aircraft  approach 
was  outside  the  empirical  envelope*  In  fnci,  In 
our  data  sample  ail  F4h  which  approached  oulbide 
the  criterion  envelope  landed  sun  tssfully.  At 
night,  however,  landing  success  for  final 
approaches  outside  llv  criterion  envelope**  was 
only  45  percent  for  P4  and  55  percent  for  A 4 
approach!.: *. .  .  In  both  aircraft,  expert*  need  pilots 
were  ut  the  thru* tie.  For  inexperienced  pi  Lots 
(lb),  night  landing  fin. -cess  was  only  19/1  compared 
with  38%  by  day.  Lower  boarding  rates  for  F8 
carqu-tl  pilots  probably  refLuels  more  stringent 
approach  tolerances,  i.e.,  more  techni<J»e  wave- 
offs  applied  by  LSOa v  as  veil  as  less  pilot 
proficiency  in  salvaging  "poor"  (-2))  approaches. 
The  practical  consequences  of  exceeding  the 
empirical  criteria  arc  obvious.  At  night,  fewer 
appmoehes  result  In  successful  landings  if  ulr- 
ctMIt  ex  Cecil  empirically  derived  performance 
cri teri a. 

DISCUSSION 

We  have  seen  that  the  major  difference  between 
Jay  and  night  carrier  approach  performance  was 
found  in  altitude  error  icnUrol.  At  night,  with 
an  Impoverished  visual  field,  final  approach  per¬ 
formance  showed  more  altitude  variability,  a 
greater  percentage  of  aircraft  below  glide  slope, 
higher  holier  rates,  and  most  s  Ign  i  f  l  c?-- 1 ,  less 
landing  success  as  measured  by  overall  boarding 
rate.  At  night,  altitude  Information  during 
final  approach  to  carrier  landing  Is  provided 
by  the  Fresnel  lens  optical  landing  system. 

No  one  can  guarantee  that  night  Lauding  perform¬ 
ance  can  be  improved.  it  may  be  as  good  now  as 
ll  ever  will  he.  The*  data  reported  here,  however , 
strongly  suggest  that  the  greatest  payoff  in 
improving  night  landing  performance  lies  In  pro¬ 
viding  better  altitude  control  information.  We 
now  have  el ear cut,  objective  evidence  of  where 
to  place  the  emphasis  in  future  visual  landing 
aid  design. 

Just  as  no  one  can  guarantee  improved  night  per¬ 
formance  so  no  one  can  guarantee  fewer  night 
landing  accidents.  The  present  accLdent  ratio 
of  approximately  4:1  (night  vs.  day)  may  be  as 
hr.*  as  we  can  expect  given  the  Interactions  and 
complexities  of  the  present  system  variables. 

The  lauding  performance  data  do  not  necessarily 
portend  any  reduction  in  the  existing  carrier 
landing  accident  rate.  Night  approaches  are  more 
difficult  than  routine  day  approaches,  simply 
because,  as  many  pilots  put  it,  "At  night,  Lt‘s 
dark,  Yuu  can't  Hue,"  Throw  in  a  black,  moonless 
night,  no  horizon,  low  fuel  state,,, and  the 
probability  of  a  successful  recovery  rapidly 
diminishes.  Under  such  conditions  the  l anding 
accident  potential  increases  as  deviations  in 
landing  performance  Increase.  With  less  than 
optimal  conditions  (pitching  deck,  carrier  quali¬ 
fications)  the  number  of  unsuccessful  approaches 


begins  to  increase  and  the  boarding  rate  drops. 

The  overall  effectiveness  of  carrier  landing 
system  performance  Is  sharply  reduced. 

The  fundamental  question  to  be  addressed,  however, 
is  wncLiiet  vKibtiug  iilghL  approach  pcr.wrrMat.ee 
with  its  increased  altitude  control  variability, 
increas'd  percentage  of  low  approaches,  and  higher 
bolter  rates  --  is  acceptable  system  performance. 

If  it  is  not,  then  major  emphasis  must  be  placed 
on  improving  the  presentation,  reliability  and 
stability  of  height  guidance  visual  rues  In 
existing  and  future  visual  lauding  aids.  One 
such  system  now  under  development  by  the  Navy 
is  CIJVSS  (carrier  landing  aid  hi  abi  lizailon 
system).  Mure  sensitive  and  pteciso  visual 
information  must  be  provided  to  the  pilot  to 
reduce  his  uLtltude  performance  variability 
during  night  carrier  approaches. 

We  now  have  empirical  quantitative  ineasun  s  of 
carrier  land  Lug  performance  utilizing  the  Fresnel 
lens  optical  landing  system.  Unfortunately,  such 
objective  data  were  not  available  during  fleet 
evaluallun  of  the  Fresnel  Lens.  Similar  empirical 
data  on  Landing  performance  based  on  new  ur 
modified  visual  landing  aids  are  essenLial. 
Comparisons  can  then  be  made  to  the  baseline 
performance  data  reported  here  to  provide  a 
basis  for  evaluating  visual  landing  aids  In 
terms  of  statistical  distributions  through 
measures  of  accuracy  (n)  and  precision  (u)  u£ 
final  approach  performance  under  a  given  set  of 
conditions. 

Along  tlie  way  to  collecting  obJec.ii.ve  perform¬ 
ance  data  to  evaluate  visual  landing  aids, 
several  fali-outs  have  occurred.  In  the  search 
for  a  criterion  to  assess  the  Influence  of 
system  components  on  landing  performance,  empiri¬ 
cal  performance  criteria  were  developed.  Their 
practical  implications  were  i 1 lus trnted  bv 
describing  carrier  landing  success  i:i  terms  of 
how  high  or  Low,  left  or  right,  an  approach  i.an 
hi-  anti  still  result  in  successful  recovery. 

Night  approaches  outside  empirically  developed 
envelopes  were  seen  to  represent  potential  acci¬ 
dents  because  of  their  extreme  deviation  (>i2o) 
fro:?  mean  approach  performance,  based  on  the 
likelihood  of  successful  landing,  those  approaches 
place  a  pilot  "in  extremis"  and  become  calculated 
risks.  At  night,  1/8  mile  from  touchdown,  landing 
success  for  FA  approaches  outside  the  empirical 
envelope  was  45%.  handing  success  inside  the 
envelope  was  86%.  Which  approach  would  yon  pre¬ 
fer? 

Thu  usefulness  of  Landing  performance  data  con¬ 
tinues  to  expand.  Currently,  the  objective 
measures  are.  being  used  in  training  Landing  Signal 
Officers  (LSO)  and  as  a  trainLng  feedback  ilevici* 
for  pilots  and  LSOs  after  initial  carrier  landing 
qualifications  and  actual  fleet  exercises.  A 
graphic  presentation  of  final  approach,  perform¬ 
ance  data  is  used  to  illustrate  to  the  pilot  his 
actual  approach  performance  in  terms  of  several 
continuously  recorded  variables,  LSOs,  on  the 
other  hand,  have  used  the  data  as  a  reliable 
check  on  their  own  proficiency  In  monitoring 
carrier  approaches.  In  addition,  the  empirical 
performance  criteria  can  be  used  to  validate  flight 
training  school  measures  and  provide  operational 
feedback  to  training  personnel  on  the  relative 
performance  of  fleet  pilots. 


rvx^r  divc.hv.vm} 

Brictson,  C.A.  Measures  of  pilot:  performance: 
Comparative  analysis  of  day  and  night 
carrier  recoverj.es  ^  Santa  Mor.ica,  Calif.! 
Dunlap  and  Associates,  Inc.,  June  1966. 

Brictson,  C.A.,  Hag^n,  P.F. >  A  Uulfprk,  J.W. 

Measures  of  carrier  landing  performance  under 
combat  conditions.  Santa  Monica,  Calif.: 
Dunlap  and  Associates,  Inc.,  June  1967. 

Eldridge,  R.A.  The  carrier  landing  story. 

Approach ,  1961,  _7« 

Shub,  L. ,  Hupp,  L.W.,  6  Anew,  R.  AN/SPN-10 

automatic  carrier  landing  system.  Buffalo, 
New  York:  Bell  Ac  rosy h terns  Company,  1962. 

wintcrburg,  R.l’.,  Brictson,  C.A.  ,  6  Wulfcck,J.W. 

A  rationale  for  evaluating  visual  landing 

aids:  Night  carrier  recovery.  Santa  Monica, 
Calif.:  Dunlap  and  Associates , Inc, , 

February  1964. 


CARRIER 


1/2 


1/4 


1  IS 


RAMP 


RANGE  TO  TOUCHDOWN  (MILES) 

Figure  1  F4  day  and  night  altitude  error  envelopes  <r,*:2o) 


LU 

CL 

O 

— I 
LO 

Ui 

o 

C> 


o 

dJ 

CO 

UJ 

31 

O 

< 

o 

or 

a. 

a. 

< 


o 

u 


EL 


AIRCRAFT  TYPE  AND  CARRIER 


Figure  2 


Percentage  of  aircraft  below  glide  slope  for  day  and  night 
approaches  at  1/8  mile 
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Day  and  night  altitude  error  envelopes  for  F8  aircraft  during 
initial  carrier  qualifications 
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SUMMARY 

Tho  Boeing  Company's  new  multimlsaion  simu¬ 
lator,  combining  a  160°  "real-world11  visual 
display  In  high-resolution  color,  together  with 
a  Luioplelely  functional  and  correlated  cockpit, 
is  described.  The  slnulator  permits  lrorews  to 
train  in  proposed  aircraft  and  avionics  systems 
and  fly  real-time  missions  over  specially 
designated  areas  of  the  United  States.  The 
simulator  was  designed  to  evaluate  aircrew  per¬ 
formance  using  state-of-the-art  concepts, 
controls,  and  displays  incorporated  in  the 
cockpit  of  an  advanced  flghter/attack  aircraft. 

Visual  target  acquisition  performance  was  used 
as  a  measure  of  task  loading  in  tests  of  one- 
end  two-man  crews  flying  both  realistically 
task-loaded  missions  and  sequences  requiring 
visual  target  acquisition  only.  Visual  target 
acquisition  performance  of  two-man  crews  wes 
significantly  better  than  that  of  one-man  crews 
in  both  types  of  flights. 
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the  Boning  Company  has  developed  a  research 
facility  for  evaluating  aircrew  performance  In 
proposed  aircraft  with  Integra ted  avion Ice  sub- 
f ye terns.  This  facility  la  the  Boeing  Haiti- 
mission  Simulator. 

The  simulator  Incorporates  advanced  aircraft 
designs  with  otato-of-the-art  avionics,  displays 
and  controls.  Hew  aircraft  performance  require¬ 
ments  ore  established,  airframe  models  are 
tested  In  wind  tunnels ,  and  the  final  flight 
dynamics  are  programmed  into  a  high-speed 
hybrid  computer.  Terrain  elevation  data  from 
Army  Hap  Service  ooqiuter  tapes  are  fed  into 
the  computer  memory  bank  so  that  flight  can  be 
simulated  over  designated  portions  of  the 
United  States. 

Integrated  in  the  flight  deck  are  inter¬ 
changeable  avionics  displays  and  controls.  The 
hardware  portions  of  the  avionics,  film  readers, 
and  flying  spot  scanners  are  housed  under  the 
flight  deok.  The  displays  are  driven  by  the 
hybrid  computer  logic  In  response  to  aircrew 
control  settings. 

The  capabilities  of  the  Hultimlasion  Simu¬ 
lator  as  presently  configured  are  > 

(1)  Low-level,  high-speed  flight 

(2)  Terrain  following  and  terrain  avoidance 

(3)  Radar  navigation 

(1;)  Oround  attack 

(5)  Air-to-air  combat 

(6)  flight  ccntrole/sensor  displays 

evaluation 

(7)  Defense  displays  evaluation 

(BCM  and  missile  threat) 

(8)  VFR  target  acquisition 

(9)  Data  record i.ig  and  reduction 

(10)  Stimulus  material  playback 

The  simulator  flight  deck  incorporates  the 
controls  for  two  major  systems.  These  are 
composed  ofi 

(1)  The  major  airframe  subsystems 

a.  Flight  controls 

b.  Flight  and  engine  instruments 

c.  Propulsion 

d.  Landing  gear 

e.  Hydraulics 

f.  Electrical  power 

g.  Fuel 


h.  Life  support 

and 

(2)  The  major  avionics  subsystems 

a,  integrated  communication, 
navigation  (radio),  and  iden¬ 
tification 

b.  Integrated  navigation  (dopplar, 
inertial.  LORD),  OARS,  digital 
eceputer  ) 

o.  Hultimlasion  radar 

d.  weapons  control 

e.  Displays  (HUD,  VSD,  HSD,  radar 
repeater) 

f.  Integrated  self-test  and  checkout 

The  simulator  operates  under  two  separate 
flight  conditions  -  a  VFR  mode  simulating  flight 
under  Visual  Hete/Wiojical  conditions,  and  an 
IJR  mode  simulating  flight  under  Instrument 
Meteorological  Conditions. 

Hi  the  VFR  mode,  the  primary  display  is  a 
lS-ft.  radius  screen  upon  which  is  projected 
high-resolution  color  motion  Picture a  of  low- 
altitude,  high-speed  flight  over  standardized 
flight  corridors.  A  realistic,  external 
fiald-of-viev  extends  ifiO0  laterally  by  60° 
vertically.  In  VFR  missions,  the  flight 
dynamics  of  the  simulator  are  controlled  by  the 
Automatic  Flight  Control  System  operating  In 
the  Automatic  Terrain  Following  mode;  the 
flight  path  of  the  simulator  Is  determined  by 
the  autonavlgatian  system  In  conjunction  with 
preset  checkpoints  along  the  test  course.  In 
tbs  XFR  mode,  the  pilot  can  control  his  own 
flight  path  within  a  25-nille  wide  corridor 
assigned  for  bis  mission. 

The  aircrew  can  operate  the  simulator 
systems  In  real-time  under  normal,  degraded 
mode,  or  emergency  conditions.  Complete 
missions  can  be  programed  to  include  enemy 
ground  defenses  and  air  threats,  end  sensor  and 
aircraft  systems  failures. 

During  the  course  of  the  missions,  the 
hybrid  computer  monitors  and  records  the  crew 
operating  procedures.  Tine  of  switch  actua¬ 
tions,  navigation  update  errors,  and  weapon 
delivery  errors  are  typed  out  by  the  computer; 
actual  flight  profiles  and  system  parameters 
are  traced  out  in  analog  graphics.  A  closed 
circuit  TV  system  monitors  crew  actions  and 
records  the  missions  on  video  tape;  aircrew 
communications  are  recorded  an  FH  tape.  Id 
addition,  direct  observation  of  the  aircrews  Is 
poseible  from  an  enclosed  experimenter's  balcony 
and  control  station. 

The  complexity  of  the  Hultimlssion  Simulator 
requires  rigorous  training  for  the  individual/* 
who  lly  it.  Operating  and  training  manuals  have 
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pt-vy uv>u  iur  um  «aw  tne  simulator.  Die- 
play  and  control  mockups  are  used  as  teaching 
aids  In  the  ground  school.  Cockpit  checkouts, 
familiarisation  nights,  and  training  z&sslxuw 
are  conducted  pr^or  to  scheduled  tests.  Selec¬ 
tion  can  be  Bad#  from  complete  sets  of  refer¬ 
ence  material  to  establish  controlled  briefings 
for  selected  missions.  Complete  cartographic, 
reconnaissance  photography,  and  air  Intelligence 
information  Is  available.  Psychological  set  can 
be  established  by  briefings  of  hypothetical 
strategic  and  tactical  situations. 

The  Multlsilssicn  Simulator  is  a  flexible 
research  tool.  Studies  have  been  conducted  in 
target  acquisition,  aircrew  utilisation,  cockpit 
geometry,  task-load  analysis,  avionics  displays 
and  controls  analysis.  The  studies  have  used 
military  operational  pilots,  pilot-qualified 
Boeing  personnel,  and  selected  Boeing  profes¬ 
sional  personnel. 

The  results  of  studies  conducted  in  the 
Miltlmlasion  Simulator  show  that  task  loading 
and  performance  are  Interrelated  and  depend 
on  experience,  training,  equipment,  and  specific 
test  Instructions.  Task  loading  is  the  utili¬ 
zation  of  an  aircrew's  mental  and  physical 
energies  in  the  performance  of  tasks  necessary 
for  the  successful  completion  of  a  mission. 

Task  loading  is  generated  by  the  individual 
aircrew's  affort  to  accomplish  that  mission 
with  the  available  airborne  systems,  A  direct 
quantitative  measure  of  task  loading  is  diffi¬ 
cult.  However,  an  important  end  product  of 
work  load  is  performance  within  the  mission. 
Thua,  aircrew  performance  can  be  meaaured  for 
mission  subtasks  under  different  conditions,  and 
the  most  favorable  work  load  conditions  can  be 
related  to  favorable  mission  performance. 

In  several  Boeing  tests,  viBual  target  acqui¬ 
sition,  an  Important  mission  success  parameter, 
has  been  used  as  a  measure  of  task  loading.  In 
studies  Involving  team  efforts,  i;  was  found 
that  two-man  crews  acquired  prebriefed  targets 
at  significantly  greater  ranges  than  one-man 
crews.  In  missions  where  the  only  task  was 
target  acquisition,  two-man  teams  acquired 
targets  at  20  percent  greater  ground  ranges 
than  ono-nan  crews.  In  missions  where  realistic 
flight  management  tasks  were  imposed  on  the 
crew,  two-man  crews  acquired  targets  at  30  per¬ 
cent  greater  ground  ranges  than  one-man  crews. 

In  both  types  of  mission,  visual  target  acqui¬ 
sition  was  stressed  as  the  primary  objective  of 
the  mission. 

Figures  1  and  2  are  examples  of  visual  target 
acquisition  comparing  one-  and  two-man  crew 
performance  on  two  specific  targets. 

The  sharing  of  the  target  acquisition  load 
by  two-man  crews  resulted  in  significant 
improve  merit  in  visual  target  acquisition  per¬ 
formance.  The  exact  reasons  for  the  superior 
performance ,  however,  are  not  known,  .Studies 
are  planned  to  establleh  those  critical  areas 
wherein  two- man  task  loadlrg  differs  from  that 
of  the  one-man. 


Points  of  interest  are  that  two-man  crews 
apparently  made  better  use  of  the  preflight 
briefing  materials.  In  flight,  the  observers' 
perrormanee  of  routine  tasks ,  allowed  the  pilots 
more  time  for  critical  mission  objectives. 
Approaching  target  areas,  the  observers  helped 
the  team  effort  by  referring  to  In-flight 
reference  materials  while  the  pilots  were  able 
to  direct  their  attention  outside  of  the  cock¬ 
pit.  The  observers  also  pointed  out  upcoming 
checkpoints  and  target  features.  Although  the 
observers  were  unable  to  actually  trigger  the 
acquisition  response  to  a  target,  they  helped  in 
confirming  possible  targets  and  rejecting  false 
targets. 

Qenerally,  the  tvo-wui  crews  made  fewer 
mistake#  In  standard  operating  procedures  than 
the  one-man  crews  apparently  due  to  the  more 
specialized  nature  of  each  crewman's  duties, 
and  the  assistance  afforded  the  pilot  by  the 
observer  in  calling  out  necessary  requirements 
at  proper  times.  There  wero  some  two-man  con¬ 
flicts  generated  by  Inadequate  meshing  of  the 
crew's  workload.  However,  these  were  generally 
resolved  with  training  and  experience.  The 
conclusion  was  that  two-asn  problems  were  out¬ 
weighed  by  their  overall  Improved  performance. 

There  are  many  other  areas  which  are 
suitable  for  investigation  with  the  Multi- 
mi  aeion  Simulator.  The  prime  one  ia  the 
analysis  of  Improvement  of  mission  performance 
through  (1)  Improved  sensor  and  predesignation 
displays,  (2)  the  display  of  reference  mater¬ 
ials  In  flight,  and  (3)  the  optimal  allocation 
of  task  loading  between  the  pilot,  his 
avionics,  and  crew. 

Target  acquisition  performance  has  been 
used  to  determine  the  relative  degree  of  task¬ 
loading  between  one-  and  two-man  crews.  The 
tvo-iuan  configuration  is  considered  more 
desirable  because  of  significantly  improved 
mission  performance. 

It  is  felt  that  an  adequate  analysis  of 
mission  performance  requires  a  realistic  and 
real  time  analysis  of  aircrew  task  loading. 

The  Boeing  Multimission  Simulator  provides  this 
capability  and  haa  been  a  useful  tool  in  the 
study  of  task  loading  and  mission  performance. 
By  using  the  simulator,  performance  can  be 
effectively  improved  through 

(1)  Proper  systems  and  equipment  design 

(2)  Training 

(3)  Proper  crew  utilization 

(I» >  Confidence  induced  by  systems 
reliability  and  accuracy 

(5)  Experience. 
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Figure  1,  Comparison  of  One-  and  Two-nan  Crews.  Visual  Target  Acquisition  I’erforaance 
Curves  Combining  Kission-Loaded  and  Acquisition  Only  oequencea.  Target  Hadar  Van. 
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PHYSIOLOGICAL  ASSESSMENT  OF  PILOT  STRESS  DURING  LANDING 
K.  G.  Corkindale,  F.  G.  Cunning,  MBE,  and  A.  M.  Hanmcrton-Fraaer 

1.  WHEN  IN  1965  it  was  decided  to  investigate  the  value  of  physiological  measures  of  pilot  stress 
during  landing,  a  joint  programme  between  the  RAF  Institute  of  Aviation  Medicine  and  the  Royal 
Aircraft  Establishment  was  agreed,  starting  with  a  study  of  compensatory  tracking  on  a  digital 
display  under  laboratory  conditions  (1). 

As  a  result  of  the  encouraging  results  obtained  from  this  investigation  it  was  decided  that  the 
feasibility  of  the  techniques  used  should  be  studied  in  the  real  flight  situation,  and  to  use  as 
this  flight  situation  trials  being  conducted  at  the  Royal  Aircraft  Establishment,  Bedford,  by  the 
Blind  Landing  Experimental  Unit  (BLEU)  with  the  hope  that  the  physiological  measures  could  be  ured 
to  augment  the  objective  and  subjective  assessments  of  performance. 

A  physiological  recording  system  had  to  be  developed  for  this  trial,  suitable  for  installation 
in  a  fairl;  large  aircraft.  Basically,  the  system  reduced  a  set  of  physiological  measurements  into 
cumulative  digital  form  which  were  photographically  recorded  at  ten  second  intervals.  The 
measurements  taken  being:- 

a)  integrated  arm  muscle  activity. 

b)  integrated  leg  muscle  activity. 

c)  skin  resistance  activity. 

d)  respiratory  rate. 

e)  respiratory  flow. 

f)  end  tidal  carbon  dioxide. 

g)  heart  rate. 

This  set  of  measurements  was  the  same  as  that  used  by  Benson  et  al  (1)  in  the  early  laboratory 
series  with  the  omission  of  respiratory  peak  flow.  A  full  description  of  the  equipment  is  given  by 
Hammorton-Frasor  (2) . 

After  testing  in  laboratory  conditions  the  system  was  transferred  to  a  rack  in  the  forward 
passenger  cabin  of  a  Comet  jet  transport  aircraft  at  BLEU,  Bedford. 

The  reason  why  the  Comet  was  chosen  was  that  the  programme  being  undertaken  by  the  Blind  Landing 
Experimental  Unit  at  that  time  involved  landing  with  or  without  Autoland  facilities  either  completely 
blind  or  in  various  degrees  of  fog  conditions  and  it  was  felt  that  this  particular  exercise  should 
give  as  reasonable  stressful  a  situation  as  one  could  possibly  hope  for  in  an  early  investigation. 

2.  THE  EXPERIMENTAL  PROGRAMME 


Initial  flight  tests  showed  that  the  carbon  dioxide  recording  equipment  would  not  work  satis¬ 
factorily  at  that  time  under  the  airborne  conditions  and  eventually  it  was  decided  that  this 
measurement  would  be  abandoned.  However,  after  successful  flight  testing  of  the  remainder  of  the 
system  a  series  of  nine  sorties  was  completed  in  February  1967  in  which  recordings  were  made  on  the 
back  of  the  aircraft  flight  programme. 

Initial  analysis  of  the  data  from  these  runs  undertaken  while  the  aircraft  was  grounded  for 
modification  led  to  the  conclusion  that  with  only  four  subjects  available  for  this  experiment  it 
would  be  difficult  to  make  any  valid  deductions  from  the  physiological  measurements  unless  they  were 
made  in  a  statistically  balanced  programme  of  flights. 

The  reason  why  such  a  controlled  programme  was  required  was  that  it  had  become  apparent  from  inspec¬ 
tion  of  the  initial  ground  ad  airborne  recordings  that  there  was  a  basal  decline  in  the  subjects 
level  of  physiological  arousa.  in  activity  from  the  beginning  to  the  end  of  flights  of  the  duration 
intended.  This  flight  duration  of  some  90  minutes  was  due  to  the  operational  use  of  the  aircraft  and 
it  was  clear  that  unless  this  effect  could  be  balanced  out  by  varying  the  order  of  different  types  of 
approach  within  each  flight  misleading  conclusions  might  be  drawn  from  this  data. 

A  balanced  programme  of  16  flights  comparing  two  conditions  of  visibility  (fog  screens,  and 
clear)  and  two  control  conditions  (head-up  or  head-down  display  of  information)  was  designed  (Table  1) 
and  this  programme  commenced  in  July  1967.  In  the  event  owing  to  problems  of  aircraft  availability 
only  9  flights  were  completed  before  the  equipment  had  to  be  removed.  Only  data  obtained  during  these 
9  flights  will  be  considered  in  this  paper. 

In  summary,  this  programme  had  two  main  aims:- 

1)  to  investigate  the  feasibility  of  obtaining  records  of  a  pilot's  physiological  activity  in 
flight  under  operational  rather  than  experimental  conditions. 

2)  to  determine  the  usefulness  of  physiological  recording  in  the  assessment  of  pilot  work  load. 

3.  EXPERIMENTAL  METHOD 

(i)  FLIGHT  PATTERN.  The  aircraft  normally  took  off  at  maximum  landing  weight  so  it  was  able 
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to  go  straight  into  the  circuit  pattern.  This  usually  permitted  8  approaches  to  be  made  including 
the  final  landing.  Each  circuit  from  take-off  to  touch-down  took  approximately  10  minutes,  circuit 
height  being  1500  feet. 

The  types  of  approach  being  studied  by  BLEU  included  full  autoland,  with  the  pilot  acting 
purely  as  a  monitor;  manual  instrument  approach  using  head-up  or  head-down  displays  with  and  without 
auto-throttle.  The  head-up  display  was  of  a  pure  director  type. 

These  manoeuvres  could  all  be  carried  out  either  under  clear  screen  conditions  or  with  fog 
screens  simulating  visibility  ranges  down  to  Category  3  conditions. 

During  the  early  airborne  series  of  runs  physiological  recordings  were  taken  from  the  end  of  the 
downwind  leg  through  touchdown  into  the  overshoot  phase.  From  these  readings  it  became  apparent,  as 
might  have  been  expected,  that  the  most  marked  and  consistent  changes  in  physiological  activity 
occurred  during  the  last  2  minutes  prior  to  touchdown;  therefore  in  the  balanced  series  of  9  flights 
recordings  were  only  taken  over  this  2  minute  period. 

TABLE  1.  PHVSIOLOCICAL  ASSESSMENT  OF  PILOT  STRESS  DURINC  IANDINC  EXPERIMENTAL  DESIGN 


REQUIREMENTS 

(i)  No  subject  should  perform  two 
flights  in  one  day. 


(ii)  Flights  in  each  set  should  be 
completed  before  those  in 
the  next  set  are  started. 


(iii)  In  each  flight  circuit  1 

should  be  autoland  with  fog 
screens.  Circuits  2  to  6 
should  then  be  recorded  as 
shown.  If  any  of  the  re¬ 
quired  approaches  is  not 
completed  it  should  be 
repeated,  and  recorded,  in 
circuit  7.  If  not  so  used, 
circuits  7  and  onwards  may 
be  used  for  any  desired 
purpose . 


(ii)  THE  SUBJECTS.  All  the  four  subjects  were  qualified  Test  Pilots  of  the  Blind  landing 
Experimental  Unit  at  the  Royal  Aircraft  Establishment,  3edford. 

(iii)  DATA  REDUCTION.  The  six  measures  were  integrated  over  ten  second  epochs  from  2 
minutes  prior  to  touchdown  through  to  touchdown.  This  c.ata  was  then  further  grouped  to  30  second 
periods  giving  four  intervals  before  touchdown. 

As  the  balanced  design  was  not  able  to  be  completed  the  analysis  that  followed  used  data  from 
only  two  circuits  for  each  subject  under  each  of  the  four  conditions  although  all  subjects 
comolctcd  at  least  ten  circuits. 

In  summary  therefore  we  havc:- 

b  physiological  measures, 

4  time  epochs  before  touchdown, 

2  viewing  conditions, 

2  display  nodes 

2  eircuits  per  working  conditions  per  subject. 


SUB¬ 

JECT 

CIRCUIT 

NO. 

SET 

1 

SET 

2 

SET 

3 

SET  A 

flicht  l 

FLICHT  5 

FLICHT  9 

FLICHT 

13 

2 

FS 

HD 

C 

HD 

FS 

HU 

C 

HU 

3 

HU 

HU 

HD 

HD 

I 

A 

C 

HD 

FS 

1ID 

C 

HU 

KS 

HU 

5 

HU 

HU 

KD 

HD 

6 

FS 

HD 

C 

HD 

FS 

H’J 

C 

HU 

FLIGHT  2 

FLIGHT  6 

FLIGHT  10 

FLICHT 

IA 

2 

FS 

HU 

C 

HU 

C 

HD 

FS 

1ID 

3 

HD 

HD 

HU 

HU 

II 

4 

C 

HU 

FS 

HU 

FS 

HD 

C 

HD 

5 

HD 

HD 

HU 

HU 

6 

FS 

HU 

C 

HU 

C 

HD 

FS 

HD 

FLICHT  3 

FLICHT  7 

FLICHT  11 

FLICHT 

15 

2 

C 

HU 

FS 

HU 

FS 

HD 

C 

HD 

J 

HD 

HD 

HU 

HU 

III 

A 

FS 

HU 

C 

HU 

C 

HD 

FS 

HD 

5 

HD 

HD 

HU 

HU 

6 

C 

HU 

FS 

HU 

FS 

HD 

C 

HD 

FLICHT  .A 

FLIGHT  8 

FLICHT  12 

FLIGHT 

16 

2 

C 

HD 

FS 

HD 

C 

HU 

FS 

HU 

3 

HU 

HU 

HD 

HD 

IV 

A 

FS 

HD 

C 

HD 

FS 

HU 

C 

11U 

5 

HU 

HU 

HD 

HD 

6 

C 

HD 

FS 

HD 

C 

HU 

FS 

HU 

VISIBILITY.  C  =  CLEAR  CONTROL.  1IU  =  HEAD-UP 

FS  »  FOG  SCREENS  HD  =  HEAD-DOWN 
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4.  RESULTS 

The  data  obtained  was  subjected  to  6  analyses  of  variance,  one  for  each  physiological  measure 
The  results  of  these  analyses  are  summarised  in  Table  2. 

TABLE  2.  SUfflARY  OF  ANALYSIS  OF  VARIANCE  RESULTS 


Source  of 
Variance 

Physiological  Measure 

Arm 

Activity 

Leg 

Activity 

Skin 

Activity 

Respiration 

Rate 

Respiration 

Flow 

Heart 

Rate 

Periods  (P) 

** 

- 

- 

- 

** 

AAA 

Head-Up  v. 

_ 

_ 

_ 

A 

Head-Down (D) 

Fog-Screen  v. 

* 

_ 

_ 

A 

AAA 

Clear  (C) 

P.D. 

- 

- 

- 

- 

- 

- 

P.C. 

- 

- 

“ 

— 

— 

D.C. 

- 

AAA 

“ 

“ 

— 

AAA 

Key:  *  Statistically  significant  at  p  ■  0.05 

**  "  "  ”  P  -  0.01 

***  "  "  "  p  -  0.001 


In  addition  to  these  findings  a  significant  difference  in  the  level  of  response  between  subjects 
was  demonstrated  for  the  6  measures.  Whenever  a  significant  difference  shown  in  Table  2  was  demon¬ 
strated  it  was  always  of  the  same  general  pattern,  that  is  that  higher  physiological  activity  was 
associated  with  approaching  the  ground,  and  with  the  presence  of  fog-screens. 

Table  3  illustrates  the  findings  of  what,  from  this  study,  appears  to  be  the  most  sensitive 
measure,  namely  heart  rate.  The  data  shown  is  the  average  value  across  four  subjects  and  two 
circuits  per  working  condition. 

TABLE  3.  HEART  BEATS  (COUNT  OVER  30  SEC.) 


Time  To 
Touchdown 
(mins) 

FSHD 

FSHU 

CHD 

CHU 

Average 

2 

54.88 

53.13 

46.38 

54.38 

52.19 

U 

57.00 

56.38 

47.13 

55.25 

53.94 

1 

63.00 

58.75 

51.13 

58.25 

57.78 

1 

68.75 

61.50 

56.88 

61 .88 

62.25 

Average 

60.91 

57.44 

50.38 

57.44 

56.54 

If  the  physiological  data  compiled  as  in  Table  3  is  ranked  (1  *  least  activity)  for  each  working 
condition  with  respect  to  the  4  time  periods  before  touchdown  then  the  sum  of  these  ranks  for  each 
working  condition  demonstrates  the  increase  in  physiological  activity  during  the  course  of  the 
approach. 


TABLE  4.  SUM  OF  RANKS  OF  6  PHYSIOLOGICAL  MEASURES 
FOR 4  WORKING  CONDITIONS  OVER  4  TIME  EPOCHS 


Working  Condition 

Time  to  Touchdown  (rains) 
2.0  1.5  1.0  0.5 

Fog-screen,  Hoad  down 
Fog-screen,  Head-up. 
Clear,  Head -down 

Clear,  Head -up 

10  11.5  18.5  20 

12  10  15  23 

9  12  15  24 

11.5  7.5  1<  22  . 

5.  DISCUSSION 

5.1.  GENERAL.  Experience  in  this  trial  indicates  the  feasibility  of  using  physiological  .issessment 
techniques  in  the  field  without  inconvenience  to  either  the  trial's  staff  or  to  the  aircrew  subjects. 
The  fitting  of  the  sensors  was  accomplished  by  non-specialist  staff  in  less  than  15  minutes  bet  ore 
each  flight  and  did  not  interfere  with  the  pilot's  airborne  activities  in  any  way. 


With  the  exception  of  the  carbon  dioxide  recording  equipment  all  of  the  measurement  techniques 
worked  reliably  over  the  period  of  the  trials  without  causing  any  maintenance  problems.  Of  the 
measures  employed  and  wichin  the  limits  of  the  data  reduction  and  analysis  techniques  used  it  would 
appear  that  the  most  sensitive  physiological  parameter  is  heart  rate,  a  finding  that  has  been  shown 
by  many  laboratory  studies.  It  is  known,  however,  that  more  sensitive  analysis  procedures  arc  poss¬ 
ible  for  the  parameters  recorded  in  this  trial.  For  example,  during  the  course  of  this  trial  one 
of  the  authors  has  developed  a  method  of  assessing  changes  in  skin  resistance  uhich  is  more  sensitive 
to  the  effects  of  working  conditions  than  the  methods  used  in  this  report  (3).  Similarly,  Opton  et 
al  (4)  have  shown  that  the  utility  of  heart  rate  measures  can  be  improved. 

5.2.  ASSESSMENT  OF  TRIAL  VARIABLES.  In  assessing  the  differences  between  working  conditions  that 
have  been  demonstrated  in  this  trial  two  points  should  be  considered.  Firstly,  not  all  of  the 
planned  flights  were  completed  and  hence  the  amount  of  data  available  is  less  than  could  have  been 
desired.  Secondly,  all  of  the  four  subjects  were  experienced  pilots  familiar  with  the  various 
aspects  of  the  trial  and  less  likely  to  show  wide  variations  in  response  as  the  conditions  were 
changed  than  would  a  group  of  less  skilled  pilots. 

When  differences  were  shown  (see  Table  2)  the  various  physiological  measures  gave  excellent 
agreement  on  the  direction  of  the  difference.  Three  parameters  showed  increased  physiological 
activity  as  the  time  to  touchdown  decreased.  Similarly,  the  same  three  measures  showed  heightened 
physiological  activity  when  fog-screens  were  in  use  compared  with  no  fog-screens.  Only  for  heart 
rate  was  a  difference  between  Head-Up  and  Head-Down  display  of  information  demonstrated  and  then  at 
a  low  level  of  statistical  significance.  In  these  two  latter  cases  the  significance  of  the  inter¬ 
action  should  be  borne  in  mind  when  making  interpretations  of  the  data. 

6.  CONCLUSIONS 

1.  Multivariable  physiological  assessment  of  pilot  stress  in  the  field  is  feasible  both  technically 
and  administratively. 

2.  Data  obtained  from  physiological  assessments  is  capable  of  providing  useful  insights  into  the 
situation  under  study. 

3.  Further  use  of  multivariable  physiological  assessments  in  both  flight  and  simulated  flight 
conditions  as  an  assessment  technique  should  be  accompanied  by  the  development  of  a  more  portable 
digital  recording  system,  using  the  principles  demonstrated  so  that  a  normative  body  of  data  can 
be  assembled. 
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Aba tract 

Research  with  a  night  rlsual  approach  a  Isola¬ 
tor  has  provided  data  supporting  a  logical  ex¬ 
planation  for  about  16  percent  of  air  transport 
accidents .  the  explanation  is  in  the  fora  of  a 
two-part  hypothesis i  a  descent  path  that  nulls 
out  sons  visual  Information  and  a  delay  in  rela¬ 
tive  motion  eupplenant  of  the  sane  lnfora-tlon. 
Tte  missing  topographic  Information  allows  incor¬ 
rect  interpretation  of  altitude  and  distance. 

Host  operational  examples  of  this  class  of  acci¬ 
dents  include  information  about  craw  distrac¬ 
tions,  critical  intrusions  and  work  loads.  In 
recent  Investigations,  the  flight  deck  work 
loads  worn  altered  by  varying  the  frequency  of 
appearance  of  other  traffic  which  the  pilot  was 
Instructed  to  detect  and  report  to  ground  con¬ 
trol.  Analysis  of  the  effect  of  work  load  on 
performance  revealed  this  to  be  a  significant 
faetcr  only  «s  it  interacted  with  terrain  slope 
and  pilot  differences,  but  not  otherwise.  These 
investigations,  along  with  previous  ones  in  the 
aeries,  have  yielded  quantitative  data  on  a 
subtle  aspect  of  night  visual  approaches  that 
may  lead  experienced  pilots  into  a  dangerously 
low  approach.  While  the  study  was  conducted 
with  commercial  Jot  experience  as  a  background, 
the  problem  le  thought  to  extend  to  all  typos  of 
operations  and  equipments  -  commercial ,  mili¬ 
tary,  end  private. 


Objectives 


o  To  determine  how  flight,  deck  work  load  may 
influence  approach  performance  under  nl^ht 
visual  conditions. 

The  results  of  the  research  will  be  used  to  iden¬ 
tify  requirements  for  hardware  and  operational 
procedures  to  make  night  approaches  safer. 


n rational  and  Methodological  Problems 


Our  major  emphasis  Is  on  the  visual  aspects  of 
landing  approaches,  and  research  results  have 
convinced  ua  that  at  least  some  of  the  “pilot 
error"  ascribed  to  approach  accidents  la  baoed 
on  incorrect  assumptions  concerning  normal  human 
visual  abilities.  For  example,  pilots  seen 
generally  unable  to  Judge  e  safe  approach  alti¬ 
tude  by  vision  alone  If  the  terrain  has  an  up¬ 
ward  slops.  They  fly  too  low.  On  the  other 
hand,  they  tend  to  follow  too  high  an  approach 
when  only  the  airport  is  risible.  Another  find¬ 
ing  is  that  they  tend  to  use  the  pattern  of  city 
lights  as  a  horixon  reference  even  if  it  results 
In  one  wli«  being  low. 


others  have  written  of  "illusions"  and  warned 
pilots  of  perceptions  of  height  and  distance 
which  might  lead  pilots  into  dangerous  opera¬ 
tional  conditions  (2,  3,  U),  Winterer  the 
mechanism  -  illusions,  oubthreshold  a ti/suli ,  or 
adequate  but  invalid  stimuli  -  the  fact  remains 
that  nonstructurally  related  accidents  are 
occurring  during  night  approached  under  good 
weather  conditions. 


Curing  the  first  eight  years  of  commercial  Jet 
operations,  that  la,  prior  to  1967,  approximately 
16  percent  of  the  major  aircraft  accidents 
occurred  during  night  approaches  over  unlighted 
terrain  or  water  toward  well-lighted  cities  and 
airports  (1).  Meteorological  conditions  In  all 
cases  ware  such  that  the  flight  crew  could  hare 
"^ployed  visual  reference  to  light  patterns  on 
the  ground.  In  1967,  the  accident  rate  under 
similar  conditions  rose  to  17.5  percent  (1). 
Accidents  Involving  highly  instrumented  aircraft 
continue  to  occur  during  seemingly  safe  night 
visual  approaches. 

Accordingly,  we  set  as  our  research  objectives 
the  following  considerations i 

o  To  determine  the  degree  to  which  night  visual 
approaches  are  unsafe. 

o  To  determine  how  specific  topography,  light 
patterns,  descent  paths,  etc.  result  in 
inadequate  visual  information. 


In  our  study  of  night  vioual  approaches,  we 
attack,  thw  problem  in  three  ways,  firot,  wo 
study  accident  reporui  t;  search  for  clues  rela¬ 
ting  the  acoident  to  the  vioual  enviruuacnt. 
Second,  we  analyse  night  approaches  In  terms  of 
the  visual  information  available  to  the  pilot 
and  what  he  would  need  to  maintain  or  correct  hie 
flight  path.  Special  emphasis  is  placed  on  thoso 
situations  where  information  from  vision  outside 
the  aircraft  may  tend  to  conflict  with  that  pro¬ 
vided  by  instruments.  Third,  we  measure  the 
actual  path  flown  by  experienced  pilote  in  a 
simulator  and  compare  this  with  requested  path 
and  with  pilots1  estimates  of  altitude. 

It  will  surprise  no  one  that  a  survey  of  acci¬ 
dent  reports  involving  couroercial  jets  showed  up 
many  more  differences  than  similarities  in  the 
visual  environments  where  these  accidents 
occurred.  However,  we  were  impressed  with  the 
difficulties  faced  by  the  pilot  whose  approach 
path  provided  him  with  a  poor  set  of  visual 


cues  -  not  the  absolute  minimum  of  derue  foe,  but 
rather  conditions  that  would  lead  him  to  trust  a 
VFR  approach  when  visual  information  is  marginal 
or  possibly  misleading.  The  moot  obvious  of  these 
conditions  Is  the  darkness  of  night  when  manmade 
oources  of  light  provide  the  only  visual  stimuli. 

The  complex  pattern  of  a  city  at  night  can 
replace  to  a  large  extent  the  normal  daylight  cues 
and  the  experienced  pilot  can  successfully  rely  on 
them  most  of  the  time  to  get  his  bearings.  There 
Is  a  redundancy  of  such  reference  points  In  an 
approach  over  lighted  terrain.  However,  an 
approach  over  water  or  unllghted  terrain  means 
that  the  visual  reference  points  occur  at  a  dis¬ 
tance  where  altitude  and  sink  rate  would  be  more 
difficult  to  Judge. 

Our  objectives  were  to  measure  the  amount  of 
information  presented  pilots  by  the  external  (to 
the  cockpit)  scene.  This  quantitative  Informa¬ 
tion  was  not  avtllabla  to  those  writing  of 
"Illusions"  In  prior  articles.  What  was  needed 
was  to  know  the  Influence  of  this  acene  on 
pilots'  estimates  of  their  altitude  and  whether 
the  estimates  were  conpatlble  with  the  actual 
altitude  that  they  would  generate  while  letting 
down. 

To  obtain  these  measurements  by  asking  pilots 
to  fly  night  approaches  to  cities  on  various 
terrain  was  not  compatible  with  the  requirements 
for  safety,  economy,  or  adequate  experimental 
control.  The  use  of  motion  pictures  to  provide 
the  night  visual  scene  for  use  In  simulators  also 
proved  noncompatible.  The  extremely  small  point 
sources  of  light  on  the  ground  from  20  miles  away 
at  altitudes  of  20,000  ft.  were  too  email  and  too 
dim  to  photograph  on  high-speed  35mm  film.  Slower 
film  of  higher  resolution  was  not  compatible  with 
aircraft  approach  speeds  and  exposure  times  for 
night  photography. 

The  photographing  of  models  of  cities  for 
experimental  purposes  la  limited  by  film  grain  and 
also  by  the  Insuffidert  resolution  or  speed  of 
color  film.  Furthermore,  photographing  to  provide 
specific  viewing  angles  and  uniform  resolution  Is 
moot  difficult. 

The  adequacy  of  visual  stimuli  was  not  the  only 
problem.  Very  senior  pilots,  first  officers, 
private  pilots,  and  nonpilots  all  have  one  thing 
In  coimton  -  differences  among  Individuals.  We, 
therefore,  had  to  turn  to  the  methods  of  experi¬ 
mental  psychology,  with  representative  sampling, 
to  gain  adequacy  of  measurement. 

Simulators  that  reproduce  all  the  flight 
characteristics  of  a  eonmereial  Jet  aircraft  are 
very  expensive.  Therefore,  Judicious  selection  of 
those  aircraft  characteristics  most  pertinent  to 
the  problem  is  required  for  the  most  efficient  use 
of  the  conventional  research  budget. 


Approach  To  The  Problem 

An  approach  to  the  problem  was  selected  to 
provide  (1)  good  quantitative  data,  (2)  compati¬ 
bility  with  the  operational  procedures  and  condi¬ 
tions,  and  (3)  pertinent  aircraft  characteristics. 
The  applicability  of  the  final  date  was  thus 
maximized  as  follows) 

o  Analytical  investigation  of  cities,  flight 
conditions,  accident  records,  and  airline 
procedures,  in  relation  to  visual  abilities. 

o  Operational  flights  to  obtain  realistic  data. 

o  Design  and  construction  of  a  simulator  con¬ 
taining  the  essential  elements  of  visual 
operational  conditions. 

o  Experimental  Investigation  of  pilot  perform¬ 
ance  and  Judgments  in  aircraft  approaches 
toward  cities. 

o  quantitative  assessment  of  each  of  the  factors 
and  their  Interaction. 

o  Recommendations  for  Improvements  In  hardware, 
procedures,  and  training  through  application 
of  research  data. 

Development  Of  A  Testable  Hypothesis 

booking  at  the  problem  from  the  etandpolnt  of 
the  visual  environment,  we  asked i  "Was  there 
something  about  those  approaches  In  the  accident 
reports  that .might  have  resulted  In  Insufficient 
Information  or  In  false  information  to  the  pilot?" 
In  this  examination,  we  considered  the  visual 
angle  that  provides  information  to  the  pilot. 

This  is  the  angle  subtended  at  the  eye  by  the 
nearest  and  farthest  lights  of  the  city  as  the 
pilot  follows  hla  flight  path.  To  a  pilot  flying 
on  a  level  course  at  a  constant  altitude,  this 
angle  Increases  progressively  as  he  approaches 
.the  city.  To  a  pilot  descending  vertically  at  a 
constant  distance  from  the  city,  this  angle 
progressively  decreases.  There  Is  a  specific 
flight  path  In  which  the  visual  angle  subtended 
by  the  elty  remains  constant.  If  the  airplane 
le  maintained  on  this  path,  the  pilot  may  be 
losing  Important  closure  Information  without  his 
awarensss.  This  approach  path  follows  ths  arc  of 
a  circle  centered  above  the  pattern  of  city 
lights,  with  Its  circumference  contacting  the 
terrain.  Such  a  path  provides  no  changing  pro¬ 
jection  of  the  topographic  plane  formed  by  the 
pattern  of  city  lights  along  the  dimension  that 
is,  in  visual  terms,  most  relevant. 

In  addition  to  the  changing  projection  of  the 
topographic  plane,  visual  information  Is  avail¬ 
able  from  the  relative  motion  of  the  light 
pattern  as  seen  from  the  cockpit.  However,  since 
this  motion  must  exceed  approximately  one  minute 
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of  visual  angle  per  second  before  It  Is  perceived, 
approaches  over  dark  areas  do  not  provide  relative 
notion  cues  until  the  aircraft  le  relatively  close 
to  the  city.  Figure  1  shows  that  at  2140  mph  and 
.1,000-foot  altltudo,  motion  would  first  be  per¬ 
ceived  eight  and  one-half  to  nine  miles  out. 
then  slowing  down  and  descending,  as  one  would  In 
an  approach,  the  notion  threshold  occurs  later. 

At  1,000  feet  and  a  speed  of  120  mph,  the 
threshold  distance  would  be  three  and  one-half 
miles. 


Figure  2  Illustrates  the  ways  in  which  visual 
angle  of  topographic  piano  projection  and  per¬ 
ceived  notion  relate  to  flight  path  and  aircraft 
velocity  for  approaches  to  level  and  to  graded 
terrain.  The  area  of  greatest  interest  in  between 
10  and  3.?  miles  out,  where  dangerously  low  alti¬ 
tudes  and  fast  sink  rates  may  result  from  the 
interaction  between  Inadequate  visual  Information 
and  topographical  variation. 

Simulation  for  Night  Visual  Approaches 


Figure  1 .  Zero  chang v  approach  path  and  thresholds 
tor  parcaivad  motion. 


A  simulator  for  night  visual  approaches  was 
constructed  and  the  first  studies  were  carried 
out  with  movie  films  taken  of  fluorescent  chalk 
models  illuminated  with  blue  light.  The  cameras 
wore  equipped  with  proper  filters  and  mounted  on 
scaled  approach  tracks.  With  this  simulation, 
the  pilots  provided  altitude  estimates  but  were 
not  given  control  of  their  flight  paths.  In  the 
current,  more  sophisticated  simulation,  the  city 
model  is  situated  atop  an  S-  by  10-ft,  table, 
which  would  appear  as  a  large  light  panel  if  the 
city  were  removed.  The  city  light  pattern  is 
made  of  thousands  of  tiny  raised  translucent 
bumps  in  an  otherwise  opaque  film.  The  city  thus 
remains  visible  at  simulated  ground  level,  with 
each  bump  a  point  source  of  light.  Selective 
coloring  has  been  used  to  simulate  lights  of 
sodium  yellow,  mercury  vapor,  and  tungsten.  The 
city  model  in  the  simulator  la  seeled  6  inches  to 
the  mile.  There  is  a  tendency  on  the  pert  of  the 
pilots  "flying"  the  simulator  to  try  to  Identify 
the  city  from  their  past  experience. 
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Figure  2.  tnfluance  of  topography,  distribution  of  fights. 

and  motion  thresholds  on  average  approach  paths 


fUt  ponilior.  arc!  is  Lx  ix>  the  jurae  model  At  »  3- 
d egre©  elope.  They  wore  informed  of  tlio  olopo  or 
lack  of  it  boforo  oach  approach.  Two  oUior 
vnriabloo  wore  tooled  In  tho  experiment*  storting 
altitudo  (16,000  ft.  and  ](;,000  ft.)  and  dintribu- 
tton  of  limits  (alrjiort  only,  airport  with  distant 
half  of  city,  and  airport  vidi  full  city). 

Pilots  wore  instructed  to  choosi  Jjolr  own 
tippre/arh  path  to  the  airport  at  tho  near  edgo  of 
tho  display,  ex c opt  that  they  should  attempt  to  bo 
nt  5,000  ft.  10  roileo  out  and  at  l,?hO  ft,  U.5 
mi] on  out,  at  which  diotsneo  tho  problem  ended. 
Thoy  wore  alee  asked  to  be  flying  180  mph  IAIi  at 
10  nil  on  out  and  1?0  mph  at  h  $  mtleu  out.  An 
x-’-y  recorder  at  tho  oxjtirlmcntor ’a  station  maker? 

«  continuous  record  of  tJ.e  flight  path  generated 
by  tho  pilot. 

During  each  approach,  tl>e  pilot  received  eight 
requests  for  altitude  ostiruiteo*  starting  Qt  tho 
18-mil©  point,  do  was  forced  to  giiees  becauso 
thoro  wan  no  Altimeter  in  tho  cockpit. 

To  increase  the  workload  on  tho  pilot  during 
his  approach,  he  was  roquirod  to  report  tho 
preoenco  of  other  aircraft  in  the  are  a.  Two  nimu- 
lated  oiroraft  orbited  over  the  city,  one  clock¬ 
wise,  the  other  counterclockwise .  A  apodal 
switching  arrangement  made  one  or  tho  other  air¬ 
craft  visible  for  10  seconds  at  a  tim©,  for  a 
total  of  olght  such  exposures  during  each 
approach,  The  pilot  was  alerted  to  tho  preoenco 
of  othor  aircraft  when  he  heard  co/mml rations 
betweon  the  ground  and  the  airplane  h©  wan  to 
locate.  On  do  looting  tho  oUior  airplane,  ho  was 
to  report  its  position  and  c  It  Kudo  relative  to 
hio  own,  and  its  heading, 

Experimental  findings 
Homogeneous  Terrain 

The  performance  variable  of  major  intercot  was 
generated  altitude  (tho  approach  actually  simu¬ 
lated  by  the  pilot).  The  table  below  oh  owe  tho 
relative  importance  of  the  fcffects  of  the  main 
experimental  variables  o;i  generated  altitude. 


Source 

ftirccnt  ot‘  Variance 

Hilo to 

2li.9 

DtaUncna 

19.8 

Slop,  of  city 

16 

Light  Retribution 

u.3 

Beginning  eltltuoo 

— 

Or*  of  the  main  variables,  beginning  altitude, 
had  no  significant  affect  on  generated  altitude. 
Hie  remainder  of  the  observed  variation  in  per¬ 
formance  (the  3£jC  that  f-'ee  noL  appear  in  the 
table)  occurred  as  a  result  of  two  or  more 
variables  acting  together.  All  ouch  interactions 
included  differences  in  distances  or  pilots. 


The?  largest  source  of  variation  in  gone  m  ted 
altitude  (?[#)  Is  due  to  dif  fm-encor.  among  Indivi¬ 
dual  pilots.  Whilo  individual  differences  are 
typically  large  in  human  factors  studies,  that 
finding  Is  particularly  Interesting  in  this  study 
boc.’tusa  It-  is  assumed  that  approach  paths  would  be 
rathor  standardized  for  commercial  Jot  aircraft. 
The  performance  of  Booing  pilot  instructors  In  our 
simulator  Bugg.cc  ts  that  there  aro  broad  limits  in 
the  range  of  altitudes  chosen  on  tho  baals  of 
visual  reference. 

Tho  second  largont  aourco  of  variation  in 
gonerated  altitude  in  distance  from  touchdown 
(?(#).  Thio  ru-ACure  is  actually  a  differonco 
scorn,  tho  difference  between  a  otrajght  pith 
(between  roquo.'ited  altltudec)  and  the  path  flown. 
The  pilot.  at.Arted  his  run  at.  an  exporinenter- 
cont.rolled  altitude  ( 6I4O  or  10,000  ft.)  and 
was  requested  to  be  at  5 #000  ft,  *0  miles  out  and 
1  ,?!iO  ft.  Ii.5  miles  out.  Unexpectedly,  thin 
factor  of  dist.ince  fron  touchdown  causes  leas 
variation  Jn  generated  altitude  than  dlfferencco 
among  pilot®. 

City  slope,  the  rain  experimental  variable, 
accounts  for  J6  percent  of  generated  altitude 
variation  and  ia  the  third  moot  potent  variable 
tooted  in  thiB  study*  Tho  effect  of  this 
variable  was  consiotontly  that  of  causing  tho 
pilots  to  tAko  a  lower  approach  path,  i.e.,  they 
flew  lower  when  the  city  was  aloplng  than  when  it 
was  flat. 

The  remaining  variable,  distribution  of  lights 
on  tho  terrain,  had  a  small  but  significant  effect 
on  a. 'preach  path  (li.3?C).  It  io  the  direction  of 
this  effect  that  ia  moat  intereating.  Wo  would 
expect  that  increaaing  the  Amount  of  visual 
information  by  adding  lights  would  provide  bettor 
reference  information.  However,  our  datA  suggest 
that  more  visual  information  may  actually  be 
detrimental  if  it  tends  to  be  misleading.  Thus, 
the  addition  of  lights  in  tlio  study  caused  a 
greater  deviation  in  approach  path  toward 
dangerous  altitudes  than  wae  true  when  only  the 
airport,  yaa  visible. 

It  waa  anticipated  that  the  detection  of  other 
aircraft  would  be  easier  when  only  the  airport 
lights  were  on,  and  thia  expectation  ia  supported 
by  the  data.  Approximately  four  times  as  many 
Aircraft  vent  undetected  when  all  or  part  of 
the  city  lights  were  on  as  when  wily  the  airport 
was  lighted. 

Returning  to  the  major  experimental  variable 
of  city  elope  and  the  performance  variable  of 
generated  altitude,  let's  look  ci  th®  two  curves 
in  Figure  $  for  the  effect  of  city  topography  on 
approaches  to  an  airport  when  all  the  city  lights 
are  on.  Although  the  pUote  were  informed  prior 
to  beginning  each  approach  as  to  whother  the  city 
wbb  flat  or  sloping,  their  flight  paths  were 
obviously  quite  lowor  when  the  city  vafl  sloping. 
The  visual  angle  subtended  At  the  pilot1©  oye 
by  tho  city  wu 0  very  nearly  the  earns  at  tho  h.5“ 
mile  point  for  both  cosea  -  2  degree/-  bS  ninutea 
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for  the  flat  city,  2  degree#  1*6  xinutes  for  the  variable ,  but  despite  the  cVse  reletionehlp  of 
eloping  city.  Beginning  »t  the  8 -all#  point,  the  distance  and  altitude  in  any  let-down,  one  could 

eh  path  tA  alA«a4j.e  ettw  4  «  M«e  eaeMtaa  *  -  -  ■  4M#1ltMtAA 

close  to  aero  altitude. 


What  path  did  they  think  they  were  taking? 
look  at  the  shaded  bars  projecting  upward  from 
the  pointe  on  the  lower  curve  In  Figure  5.  The 
tope  of  the  bars  represent  the  pilots'  estimates 
of  altitude  at  theae  pointe.  It  appears  that 
theae  experienced  pilots  thought  they  were  at 
approximately  the  eatae  altitudes  as  in  the 
approach  to  the  flat  city. 


•  N  -  12 

•  TOTAL  CITV 

•  STARTING  ALTITUOt  lO.OOQfl 


Figure  5.  Influence  uf  city  topography  on  descent. 


Heterogeneous  Terrain 

In  the  experiments  discussed  above,  the  run¬ 
ways,  hard. ways,  and  support  arses  had  the  sane 
terrain  as  the  city.  Controlling  airport  terrain 
to  conform  with  city  topography  allowed  us  to 
measure  Its  effect  ae  a  separate  independent 
variable.  Although  runway  slopes  exist  that 
exceed  3  degrees,  they  are  much  more  conmonly 
graded  to  be  approximately  level  and,  therefore, 
do  not  conform  to  the  surrounding  topography. 

The  logical  next  step  was  to  determine 
whether  the  influence  of  a  sloping  city  was 
independent  of  the  airport  terrain. 

In  addition,  there  was  the  question  of  whether 
additional  instrumentation  -  that  of  providing 
pilots  with  rates  of  climb  and  descent  (without 
absolute  altitude  information)  -  would  provide 
suff ioisnt  information  for  safe  let-downs.  It 
was  an  experimenter's  "gamble"  that  these  two 
variables  oould  be  studied  in  the  same  experi¬ 
ment  using  the  prior  experiment  as  a  baseline. 

The  follow-on  experimental  design  also  in¬ 
cluded  starting  distance  as  a  variable.  Starting 
altitude  had  not  proved  to  be  a  significant 


The  heterogeneous-terrain  experiments  indi¬ 
cated  that  very  similar  let-downs  were  accom¬ 
plished  by  the  pilots  regardless  of  city  topo¬ 
graphy  for  the  20  mll#A0,000-ft.  starting 
position  only.  This  starting  position  is  fami¬ 
liar  to  contorclal  pilots  as  this  is  the  FAX 
regulated  maximum  altitude  at  20  miles.  It  is 
assumed  that  approach/deecent  speeds  could  be 
set  up  successfully  with  the  two  available 
instruments  from  this  familiar  starting  point 
with  less  dependence  on  the  visual  scene. 
However,  when  the  starting  point  was  the  less 
familiar  condition  of  10,000-ft.  altitude  at 
3ii  miles,  the  final  altitudes  were  lower  for 
the  sloping  city  and  the  results  conform  to  the 
viiual  angle  hypothesis. 

Figure  6  Illustrates  the  similarity  of  the 
final  visual  angles  and  the  lack  of  similarity 
in  generated  altitudes.  Tho  pilots'  estimated 
altitudes  are  almost  identical  inside  of  the 
12-ulle  distance,  generally  underestimating 
their  altitude  toward  the  flat  city  and  over¬ 
estimating  their  altitude  on  approaching  the 
sloping  city. 

The  authors  would  conclude  that  the  city 
light  pattern  does  have  an  influence  on  pilots' 
let-down  performance  Independent,  of  the  plane 
of  the  runway. 

Work  load 

In  this  experiment,  the  night  dock  work 
load  of  the  operational  situation  was  approxi¬ 
mated  by  introducing  a  task  of  visually  detect¬ 
ing  and  reporting  the  presence  of  other  traffic. 
This  task  has  providod  data  that  concurred  with 
some  operational  dataj  i,e,,  the  difficulty  of 
detecting  other  aircraft  at  night  increases 
with  the  presence  of  city  lights.  Tho  opera¬ 
tional  data  obtained  by  others  indicated  that 
"flashing  lights",  high  intensity  areas,  and 
lights  of  similar  color  were,  in  that  order, 
detrimental  to  aircraft  detection.  Those  con¬ 
fusion  stimuli  exist  in  the  "Nighterton"  simula¬ 
tion,  and  our  prior  data  concur  in  indicating 
that  the  presence  of  city  lights  decreases  the 
detection  of  other  aircraft  by  a  ratio  of  about 
Uil. 

In  all  the  studies,  the  reporting  of  other 
aircraft  task  had  three  parts  I  (1)  tho  location 
in  asimutb  of  the  other  aircraft's  position 
relative  to  the  simulator's  flight  path;  (2)  the 
detection  and  reporting  of  the  other  aircraft's 
relative  heading;  and  (3)  the  detection  and 
reporting  of  its  relative  altitude  in  respect 
to  that  of  the  simulator  pilot's  altitude. 
Location  was  reported  in  clock  position;  heading 
as  "toward"  or  "away",  to  the  right  or  left; 
and  altitude  as  "above",  "same",  or  "below". 

The  criteria  was  +15°  for  the  first  two  areas  of 
Judgment  and  +1000  ft.  as  the  equal  category  for 


CONDITIONS: 


STARTING  DISTANCE 
STARTING  ALTITUDE 
INSTRUMENTS 

WORK  LOAD  ADDITIONS 
Runway 
REQUESTED 
FINAL  ALTITUDE 


34  STATUTE  MILES 
10  OOO  rrtr 

AIR  (AND  GROUND)  SPEED  INDICATOR 
RATE  OP  CLIMB 'DESCENT  INDICATOR 
I  OTHER  AIRCRAFT  PFR  I.FTOOWU 
FLAT,  10,000  FT  LONG,  100  FT  WIDE 

1,240  FT 


•  410  FT 

.  3'  |3' 

■  148 

•  31.02 


Figure  6 


DISTANCE  IN  MILES 

Average  Letdoern  Performance  to  Flat  end  Hoping  (3  I  Citici.  Generated  Ahi'ude. 


alt  Undo.  To  put.  the  difficulty  of  this  task  lxl  The  night  Duck  Work  Load  Experiments 

perspective,  one  needs  to  know  that  no  aircraft 

ronalned  visible  longer  than  ten  seconds.  Stork  In  ads 


The  following  table  Indicates  that  the  pro¬ 
portion  of  corroct  responses  la  similar  for 
each  of  the  sub- tasks,  city  topography  and 
starting  distances.  The  average  percentage  Is 
35.6%,  Indicating  the  difficulty  of  this  visual 
task. 


FtercenUge  of  correct  Reports  of 
Other  Aircraft  During  Night  Approaches 


location 

Heading 

Altitude 

,20  mile 

29 

36 

45 

'34  mile# 

37 

42 

45 

i20  mile 

32 

34 

32 

'34  "die* 

3o 

35 

?4 

*In  this  comparison,  only  those  aircraft  pre¬ 
sented  between  the  20-milo  and  U.S-mile  points 
are  considered,  regardless  of  starting 
distances. 


The  investigations  discussed  thus  far  used  a 
constant  work  load.  The  most  recent  Investiga¬ 
tions  studied  work  load  ae  a  primary  variable. 
The  night  visual  approach  simulator  was  modified 
to  provide  three  aircraft  flying  over  the  city 
in  separate  orbits,  their  lights  activated  by 
stepping  relays  with  nearly  random  sequencing. 

As  many  as  16  presentations  of  aircraft  could  be 
made  betwsen  the  20-mile  and  4. 5-mlle  distances. 
The  "light"  work  load  was  3  to  ii  aircraft;  the 
"medium"  was  8  or  9;  and  the  "heavy"  was  16 
aircraft  per  let-down. 

Topography/ Aircraft  Variable 

The  second  major  variable  combined  cltie3  of 
three  different  topographies  with  three  differ¬ 
ent  airports.  The  flat  city  had  the  familiar 
(to  our  pilots)  10,000-ft,  long,  300-ft.  wide 
run«ay„  This  represented  our  control  condition 
as  these  variables  have  been  used  on  each  of  the 
earlier  investigations.  The  second  topographic 
condition  was  a  1.5°  city  slope  and  a  7,500-ft, 


Figure  7  Moris  LdoJ  Experimental  Design  arid  Relationship  rtith  Other  N.V.A.R.  Experiments 


long  by  2O0-ft.  wide  runway.  The  third  topo¬ 
graphic  combination  was  a  3°  slope  and  a  5000-ft. 
long  by  100-ft.  wide  runway.  The  pattern  of 
support  buildings,  taJdvaya ,  etc.  were  modified 
to  provide  very  similar  configuratlonn  with  the 
requirement  that  they  be  operationally  feasible. 
The  runways  were  always  flat  and  the  strobe  light 
path  length  was  shortened  to  conform  to  decreased 
runway  length. 

Wind  Shear 

To  minimize  a  possible  tendency  for  pilots  to 
depend  upon  fixed  rates  of  descent  for  cosistant 
air  speeds  over  approximately  equal  times,  the 
simulator  was  modified  to  permit  the  introduc¬ 
tion  of  wind  shear  conditions.  Pre-programmed 
were  30  mph  head  and  tail  winds  which  would 
affect  the  aircraft  between  3000  ft.  and  6000 
ft.  of  altitude.  A  third  condition  had  aero 
wind  shear  in  this  altitude  band.  Above  and 
below  this  band,  there  were  no  wind  effects. 
Pilots  were  told  of  the  existence  of  these  wind 
conditions,  but  no  wind  information  specific 
to  a  given  trial  was  provided. 

City  Brightness 

The  illuminances  of  city  lights  are  modulated 
by  atmospheric  moisture  content,  the  proportion 
and  particle  size  of  air  pollutants,  as  well  as 
distance,  altitude  and  other  aircraft-related 
variables.  The  apparent,  brightness  of  the  city 
will  influence  pilot  estimates  of  distance  and 
altitude.  Included  in  these  two  investigations 
was  the  condition  of  low  city  brightness, 
figure  7  permits  the  comparison  of  the  several 
experiments  with  regard  to  the  variables  of  city 
brightness,  work  load,  and  topography/runway 
dimensions . 


Distribution  of  City  lights 

The  city  lights  represented  a  city  20  miles 
wide  and  the  most  distant  light  was  16  miles 
from  the  runway  threshold  (i.e.,  along  the  line 
of  flight).  One  exporlmont  wan  undertaken 
wherein  "the  city  was  built  out  to  the  airport" 
i.e.,  the  pattern  of  lights  was  contiguous 
from  the  airport  perimeter  lights.  The  second 
experiment  was  a  replication  of  the  first  but 
with  the  city  lights  separated  from  those  of 
the  airport.  This  disjunctive  pattern  vas 
produced  by  excluding  from  the  model  those 
lights  around  the  airport  and  those  extending 
beyond  it  for  six  miles. 

The  Booing  Flight  Crew  Training  organization 
was  the  source  of  our  very  experienced  pilots. 
The  men  average  some  17  years  of  flying  exper¬ 
ience,  mostly  in  Jets,  Including  military, 
cormercial  and  flight  test.  They  form  the 
cadre  of  instructors  who  train  airline  pilots 
in  the  operation  of  Boeing  commercial  Jots, 
and  as  a  group,  they  are  familiar  with  most 
airports  in  the  free  world.  There  wns  one 
exception  in  our  opulatlon,  A  North  West 
Airlines  Pilot,  a  First  Officer,  volunteered 
and  did  participate  in  the  oxperin«nt  with  the 
disjunctive  light  pattern. 

Flint  Briefing 

The  entire  group  of  pilots  had  received  a 
previous  briefing  on  the  results  of  our  prior 
experiments,  and  they  had  access  to  all  publics 
tion3  on  this  work.  Host  of  the  pilots  had 
participated  is  one  or  more  of  our  experiments 
and,  therefore,  they  were  varsed  in  the  known 
effects  of  terrain  on  night  approaches. 


Tho  inotructlona  fur  these  experiments  were 
written  out  and  read  by  all  participants  before 
entering  tho  cab.  During  tho  familiarization 
flight,  tnoy  couia  ask  questions  or  the  experi¬ 
menter  wiio  flew  copilot  during  this  first  let¬ 
down.  A  summary  was  given  verbally  as  a  check¬ 
out.  Before  each  of  the  nine  experimental  runs, 
all  conditions  of  the  city,  runway,  distance  and 
altitude  wore  reviewed  over  the  intercom  system, 
Only  the  conditions  of  wind  shear  and  other- 
alrcruft  traffic  load  were  not  reviewed. 

Let-down  instructions  were  to  make  good  a 
speed  of  1B0  mph  at  10  miles  out  and  120  at  L.S 
miles  out.  final  altitude  at  U.5  miles  was  to 
be  1,2U3  ft.,  the  intersection  of  a  3°  glide 
slope. 

The  Ha suite i  flight  Deck  Work  Load  Studies 

Tho  starting  altitude  and  distance  were 
planned  to  provide  a  visual  angle  of  2°li2  1 ,  or 
2.7  .  Tills  value  is  equivalent  to  the  visual 
angle  at  li.S  miles  obtainod  whon  wo  previously 
studied  tho  16  mile  deep,  contiguous  patterned 
city  with  an  intermediate  brightness.  Tho  flat 
city  and  the  3°  sloping  city  match  this  angle 
at  tho  start  of  each  descent.  Tho  starting 
altitude  for  the  1.5°  sloping  city  matches  the 
FAA  maximum  at  20  nd-lea  and  the  visual  angle  is 
3.06°. 


As  reflected  in  the  major  dependent  varl  ''’e 
of  generated  altitude,  the  net  effect  of  start¬ 
ing  with  nearly  corcaon  visual  angles  was  to 
reduce  the  principal  variables  of  "distance 
out"  and  "topography"  to  non-significance  when 
all  distances  were  Included  in  the  analyais. 

In  all  prior  investigations  for  the  "all 
distances"  analysis,  these  variables  woro 
significant.  The  "distance  out"  variable  was 
second  only  to  individual  differences  among 
pilots  in  contributing  to  the  overall  variance. 

The  influence  of  topography  on  generated 
altitude  remained  significant  for  the  6  and  ii.S 
mile  distances  when  these  were  analyzed  sepa¬ 
rately.  In  its  effect  on  estimated  altitude, 
topography  romalnod  a  algnlficant  variable  in 
the  analysis  for  the  eight  distances  combined. 

Performance  variation  attributable  to  pilots 
(individual  differences)  has  always  been  highly 
significant,  tho  probability  of  obtaining  the 
observed  variation  by  chance  alone  never 
exceeding  the  .001  level.  The  following  table 
shows  tho  probability  levels  fur  all  analyses 
conducted  on  generated  altitudes  and  estimated 
altitudes  for  each  of  tho  two  experiments 
testing  different  work  loads. 
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Figure  8  Illustrates  that,  for  the  8.0,  6.0, 
and  U.5  mile  distances  In  the  let-downs,  the 
ertect  or  topograjmy  or  tne  city  ana  runway 
configuration  van  to  result  in  lower  flight 
paths.  This  eta  terns nt  Is  true  only  for  the 
light  pstt^yn  «hich 

those  cities  which  have  built  out  to  surround 
their  coastal  airport.  The  figure  illustrates 
that  the  pilots'  estimates  of  their  altitude 
ware  slallar  to  the  generated  altitude  for  the 
intermediate  condition,  that  of  the  1.9°  eloping 
city  end  7,500-ft.  long  runway.  Their  estimates 
of  altitude  approximated  the  overall  mean, 
underestirating  the  flat  topography  and  over¬ 
estimating  their  altitude  above  the  3°  sloping 
terrain. 


Figure  8  Generated  and  Estimated  Altitudes  for  Approaches  to 
Contiguous  City  Flight  Pattern  os  o  Function  of 
Topography  and  Runways 

The  experiment  with  the  city  whose  light 
pattern  was  contiguous  to  the  airport  adds  fur¬ 
ther  support  to  the  visual  angle  hypothesis. 

The  let-downs  whose  final  3.5  miles  (i.e.,  from 
8.0  to  U.5  miles)  are  depicted  in  Figure  8 
terminate  at  altitudes  that  represent  visual 
angles  of  3°5U'  ♦  1  minute. 

These  visual  angles  are  from  SO'  to  a  degree 
larger  than  we  would  have  expected  from  the 
starting  visual  angles  and  prior  experimenta¬ 
tion.  In  previous  studies  with  the  same  city 
and  the  same  runway  (10,000  ft.),  but  with 
Intermediate  brightness,  the  average  visual 
angle  was  3°0li',  whether  the  runway  had  the  same 
elope  as  the  city  or  remained  flat.  It  could  be 
argued  that  this  visual  angle  difference  is  due 
to  the  brightness  difference  and  that  runway 
length/ width  configurations  are  of  little 
Import.  At  this  time  ouch  a  statement  remains 
merely  an  hypothesis >  an  alternative  hypothesis 
is  suggested  by  the  increased  variance  found  for 
the  flat  city  and  Its  familiar  (to  these  pilots) 
10,000-ft.  long  by  300-ft.  wide  runway.  That 
is  pilots  may  hare  remained  higher  as  a 
cautious  response  to  the  leas  familiar  runways, 
this  higher  altitude  corresponding  to  a  larger 
visual  angle.  Support  for  this  viewpoint  may  be 


found  In  the  following  table,  which  shows  that 
for  the  matched  work  load  conditions,  the 
Btanaara  deviations  for  uses  low  brightness  list 
city  are  nearly  three  times  as  large  as  those 
for  the  intermediate  brightness  city.  This 

is  across  aijcpariftaftt-s  although  th* 
separate  samplings  of  tie  pilots  are  from  the 
easts  population  and  all  had  prior  briefing  on 
the  effect  of  slope.  The  very  large  variance 
may,  therefore,  be  a  result  of  their  being 
extra  careful  against  sloping  terrain  and  co¬ 
varying  runway  lengths  and/or  relaxing  whan 
faced  with  the  "familiar"  and  "safer"  condi¬ 
tions. 

Variability  In  Approach  Altitudes 
at  Three  Distances  from  Cities  of 
Two  Brightnesses  and  with  Medium 
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As  mentioned  previously,  pilots  show  e 
general  underestimation  of  altitude  above  the 
flat  city,  good  approximation  of  true  altitude 
with  the  1.5°  sloping  city,  and  overestimation 
on  approaching  the  3°  sloping  city.  Figure  9 
illustrates  how  these  estimates  varied  with  the 
flight  deck  work  load.  Had  this  experiment 
dealt  only  with  the  two  extremes  of  the 
"topo^raphy/runvay"  dimension,  a  systematic 
Inverts  relationship  might  have  been  postulated. 
The  inclusion  of  the  1.5°  slope/7.5K  runway 
level  reflects  no  linear  effect  of  work  load. 

The  replication  of  this  experiment,  with  the 
disjunctive  city  light  pattern,  shows  under- 
estlmations  for  all  topography/runway  combina¬ 
tions.  Also  the  undereetimations  are  very 
slightly  greater  for  each  work  load  which  is 
consistent  only  with  the  above  data  for  the 
flat  city. 

These  results  Imply  that,  if  estimated  alti¬ 
tude  varies  with  this  kind  of  flight  deck  work 
load,  it  will  probably  be  measured  only  in  an 
experiment  where  the  analysis  can  include  (or 
hold  constant)  the  simulated  aircraft's  actual 
altitude. 
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Figaro  9.  Altitudo  Estimation  Error  at  a  Function  of  Work  Load 
and  Topography /Runway  Configuration 


Karller  data  with  the  intermediate  city 
brightness  had  Indies tad  that  tha  disjunctive 
city  light  pattern  was  tha  more  difficult  city 
against  which  to  make  night  visual  approaches 
without  alt  lias  try  references,  this  affect, 
though  consistent,  was  small  as  the  mean  final 
altitude  varied  between  135  and  170  feet  between 
the  contiguous  and  disjunctive  light  patterns. 
There  was  a  larger  difference  found  when  pilots 
descended  toward  airports  not  surrounded  by  city 
lights,  the  following  table  shows  the  magni¬ 
tude  of  this  offset! 


City  Light  Pattern 

City  Topography  Disjunctive  Contiguous 

Flat  612 '  k!*2 ' 

3°  Sloping  570'  U35* 

This  tendancy  to  fly  higher  toward  the 
smaller  visual  scene  may  be  a  cautious 
behavioral  pattern  associated  with  the  smaller 
image  and  slower  rates  of  change. 

In  the  work  load  experiments,  the  city 
brightness  was  the  lowest  available  with  the 
Simla  tor  and  represented  those  atmospheric 
conditions  which  would  attenuate  the  brightness 
of  pcint-llght-eources  without  Imposing  In¬ 
creased  luminous  areas  due  to  diffusion,  7he 
Influence  of  city  light  Intensity  interacting 
with  that  of  the  pattern  of  lights  appears  to 
be  Inconsistent  with  the  prior  data.  Filots 
fly  higher  approaches  to  the  disjunctive  light 
pattern  In  the  work  load  experiments  rather  than 
lower.  Figure  ID  illustrates  that  this  differ¬ 
ence  Is  765,  9U8,  and  101k  feet  for  the 
topographic/runway  conditions  Identified  as 
"A",  "B",  and  "C".  However,  If  we  postulate 
that  pilots  respond  to  tho  disjunctive  city  of 
low  brightness  as  though  they  were  flying 
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Figaro  10.  Lot-down  Porformanco  with  Different  Wert  Load,  and 
Oiffotont  City  Light  Pottornt 

toward  the  airport  lights  alone,  than  the  cur¬ 
rent  and  foruser  data  ere  consistent.  This  Is 
most  apparent  when  brightness  conditions  are 
eoqpared  for  the  flat  city/10,000-ft.  runway. 
The  intermediate  brlghtnsse  produces  about  600 
feet  of  difference  and  low  brightness  765  fast 
of  difference  In  mean  altitude.  The  longer 
differences  between  the  two  light  patterns.  In 
tarme  of  generated  altitude  performance,  are 
associated  with  the  pilots’  flying  to  shorter 
runways.  Possibly  pilots  respond  to  the  area 
of  the  light  pattern  rather  than  to  its  cogni¬ 
tive  content.  Figure  11  illustrates  that  tbs 
overall  visual  angle  Increases  with  tho  flights 
toward  tha  shorter  runways  and  the  cities  of 
greater  slope.  The  pilots  did  not  fly  to  make 
the  visual  angle  of  the  runway  e  constant.  Had 
they  done  this,  the  final  altitude  for  condi¬ 
tions  with  the  shorter  runways  would  have  been 
higher  than  tiiat  with  the  longest  runway. 

Work  load  as  a  variable  shifts  the  mean 
altitude  within  the  ranges  shown  In  Figure  10. 
The  "tip- toned”  area  on  either  side  of  the 
means  illustrates  the  maximum  variation  found 
among  the  means.  The  reader  should  be  cau¬ 
tioned  not  to  interpret  this  shaded  area  as 
the  standard  deviation  or  that  the  upper  limits 
are  always  associated  with  a  light  work  load. 
The  means  do  not  show  such  systeoatlcness. 

What  is  Illustrated  is  that,  within  the  work 
loads  studied,  the  mean  performance  was  modu¬ 
lated  In  three  different  patterns  as  a  function 
of  distance  out.  Those  patterns  of  variation 
either  increase,  remain  similar,  or  decrease 
with  decreasing  distances  from  the  runway. 

These  patterns  and  the  AH0VA  reflect  that  the 
main  effect  and  the  first  order  Interactions 
within  any  one  distance  are  not  significant. 

In  these  experiments,  flight  deck  work  load 
is  both  an  Independent  and  dependent  variable. 
We  have,  up  to  this  point,  discussed  Its 
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on  Judging  ft 10  AlUludt  ol  Other  All  Trotlic 


Influence  on  flight  performance,  or  as  a  depend¬ 
ent  measure.  We  recorded  pilot  performance  in 
detecting  and  reporting  the  position,  heading, 
and  altitude  of  other  aircraft.  These  perform¬ 
ance  measures  pertain  to  how  well  the  pilot 
performed  on  the  Independent  variable,  work 
load.  These  data  tell  us  that  ths  pilots  time- 
shared  their  tasks  In  about  the  same  proportion 
for  each  work  load. 

The  proportion  of  correct  responses  in 
detecting  and  reporting  the  ailjouth  position, 
tho  heading,  and  the  altitudes  approximated 
35  percent.  This  ie  the  approximate  proportion 
found  in  prior  experiments  with  the  lnte me¬ 
diate  work  load  condition.  The  proportion  of 
correct  Judgments  was  common  for  each  work 
load.  This  Is  reflected  by  the  percent  of 
correct  altitude  Judgments  shown  in  Figure  12. 
The  Influence  of  "work  load  categories"  Is  not 
systematic  and  of  limited  size  compared  to  the 
large  effect  of  topography.  The  greater  the 
elope,  the  lower  the  proportion  of  correct 
altitude  Judgments.  These  data,  pertaining  to 
ths  contiguous  pattern  of  lights,  may  reflect 
that  this  lower  performance  may  be  associated 
with  the  greater  probability  that  the  other 
aircraft  lights  must  be  detected  against  the 
city  lights.  A  similar  result  may  be  expected 
if  the  altitude  of  other  aircraft  are  more 
difficult  to  judge  when  the  perceived  horizon 
Is  higher  than  the  "true"  horizon.  Further 
analysis  rooy  support  one  or  the  other  of  these 
explanations ,  but  at  this  point  in  tins,  either 
hypothesis  is  acceptable. 

The  complex  interactions  of  work  load  x 
topography/runvay  x  pilots  has  proved  difficult 
to  organize  or  illustrate.  Bivariate  analysis 
depicted  in  three  dimensions  show  some  aspects 
of  this  complex  function,  but  at  this  level  of 
analysis,  they  tend  to  complicate  rather  than 


clarify.  A  portion  of  tho  problem  ny  be 
illustrated  In  the  frequency  diagrams  of  Figure 
13.  The  work  load  distributions  include  all 
topographies  and  runway  conditions .  These  work 
load  distributions  are  similar  In  their  shape, 
the  central  teixiency,  and  the  standard  devia¬ 
tion.  The  cumbers  within  the  area  of  the 
distributions  represent  the  pilots  designated 
by  number.  Each  pilot's  number  ehould  appear 
throe  times  In  each  distribution.  Their  posi¬ 
tion  along  the  horizontal  axis  coonoteu  the 
pilot's  contribution  to  the  mean  in  any  one 
let-down.  These  data  pertain  to  the  final 
altitude  and  these  are  difference-scores  above 
or  below  the  recuse ted  l,2it3  feet. 

It  will  be  noticed  that  Pilot  flew  higher 
and  much  more  varlantly  under  the  light  and 
medium  work  load  than  under  the  heavy  work 
load.  Pilot  #7  flew  higher  under  Increasing 
work  load  but  maintained  similar  variances  for 
ths  "light"  and  "heavy"  conditions.  Pilot  #6 
flew  lower  and  his  variance  increased  with 
each  increased  work  load. 

These  examples  illustrate  the  pilot  x  work 
load  interaction.  Ths  interaction  of  pilot  x 
topography/runway  1s  illustrated  by  Pilot  #5 
who  flow  lower  with  the  increasing  slope  and 
shorter  runways.  Pilot  #5  also  illustrates  the 
jecond  order  effects  in  that  heavy  work  load 
increases  his  variance  but  not  his  flying 
lower,  the  latter  being  the  influence  of  the 
topography /runway  variable. 

Conclusions 

We  conclude  that  flight  deck  work  load  in 
the  form  of  other  traffic  to  detect  and  report 
is  a  significant  variable  in  affecting  altitude 
and  estimated  altitudes  during  let-downs.  The 
effect  is  a  complex  interaction  among  this 
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WORK  LOAD  DISTRIBUTIONS  TOPOGRAPHY/RUNWAY 

CONFIGURATION  DISTRIBUTIONS 


Fiquro  13.  Distributions  of  Ganaiuttd  Alliiadas  by  Walk  Loads  and  Topogiophy/Rvnn/oy.  Position  of  Score,  A ra  by  Pilots'  Nvmbors. 


stork  load,  pilots,  and  tha  city  topograph y/nm- 
snty  conditions.  Within  ths  levels  of  work  load 
atadlad  bars,  sow  pilots  my  improve  thslr 
pc' fo manes  nndcr  hoarier  work  loads,  sons  my 
be  unaffected,  and  sows  will  deteriorate  In  their 
performance. 

We  also  conclude  that  pilots  acquire  through 
thslr  training  and  experience  a  rioual  frame  of 
reference  that  approximates  a  safe  and  conven¬ 
tional  flight  path  onto  a  flat  terrain.  Muqr 
successful  approaches  are  made  with  this  refer¬ 
ence,  particularly  with  assistance  from  instru¬ 
mentation.  Die  night  visual  approach  accldante 
with  highly  Instrumented  aircraft  then  nay  occur 
when  the  light  pattern,  topography,  etc,  provide 
invalid  visual  information ,  and  circumstances 
are  such  that  other  sources  of  information  are 
not  referred  to  or  fail  to  provide  corrective 
information.  Illuminated  topography  at  night 
siay  also  Influence  experienced  pilots  in  their 
estimates  of  the  altitudes  of  other  aircraft  in 
the  terminal  area. 


Recogsendetiong 

In  future  Investigations  of  work  load.  It  is 
reoomnended  that  the  plan  be  constrained  to 
(1)  Include  sufficient  experimental  degrees  of 
freedom  that  complex  effects  may  appear; 

(?)  that  work  load  be  treated  as  both  an  inde¬ 
pendent  and  depandent  variable ;  and  (3)  opera¬ 
tional  paradigms  be  considered  for  the  work 
load,  the  overall  task,  and  tha  alwlatlcn 
model. 

In  addition  to  these  recwsosndatlena  for  all 
aviation  safety,  we  consider  that  the  modifica¬ 
tion  of  valid  visual  angle  information  occurs 
as  a  function  of  natural,  economic,  and  chance 
conditions;  that  is,  topography,  distribution 
of  population,  irregularity  of  lights  within 
city  limits,  attenuation  of  brightness  and 
clearness  of  lights  by  atmosphere.  Han  hae  also 
by  daelgn  made  certain  cities  or  airfields  wore 
dangerous  than  others.  He  was  designing,  in 
these  instancee,  far  man's  other  comforts  or 
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safety  when  he  created  the  nor*  dangerous  air¬ 
port «  for  sight  viaual  approaches,  He  locates 
airports  away  fro*  cities,  retiring  approaches 
over  eater  or  over  deserted  fare  lands,  to  avoid 
noise  and  potential  injury  for  the  terrestrial 
population.  Be  builds  airports  by  filling  in 
shorelines  sad  by  using  rtmote  land,  m  solving 
toes  safety  problems,  ha  nay  unexpectedly  raise 
otbara.  Operations  research  people  will 
undoubtedly  aee  the  need  for  their  type  of  work 
in  this  overall  problen. 

Die  following  dty/alrport/approech  features 
are  considered  to  aggravate  this  problem  i 

o  An  approach  over  dark  land  or  dark  water 
dure  lights  to  the  aide  and  below  the  air¬ 
craft  do  not  exist. 

o  A  long  straight-in  approach  to  the  airport 
located  on  the  near  side  of  the  city. 

"  An  airport  nanny  Ian*  tii-width  relationship 
that  is  mf«irin«r  to  the  pilot. 

o  The  airport  situated  at  a  slightly  lower 
elevation  and  on  e  different  slope  from  the 
surrounding  terrain. 

o  The  navigational  faolllty  located  soee 
distance  from  the  airport. 

o  Substandard  lighting  of  the  runway,  and 
other  landing  aids  not  available. 

o  A  sprawling  city  with  an  irregular  matrix  of 
lights  spread  over  various  hillsides  In  beck 
of  tbs  airport. 

o  Industrial  smoke  or  other  obscurations  which 
decrease  the  brightness  of  lights  as  they 
Interact  with  the  distribution  of  lights 
about  the  airport.  Cities  on  Irregular  ter¬ 
rain  with  remote  airport  may  be  less  safe  an 
dear  nights. 

Die  data  being  developed  at  Boeing  support  the 
visual  angle  hypothesis  as  one  systematic 
explanation  of  night  visual  approach  accidents. 
Investigations  of  possible  solutions  to  this 
problem  and  their  Interaction  with  other  phases 
of  operations  will  take  time.  However,  there 
are  Immediately  available  means  for  potential 
reduction  of  night  visual  approach  accidents. 
These  Include  more  frequent  reference  to  alti¬ 
metry  -  barometric  or  radar,  cross  checks  with 
other  crew  members ,  and  most  Important  of  all, 
knowledge  and  awareness  of  the  special  problems 
associated  with  these  approaches. 
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illCTCRICALLT,  T12:  DESIGN  ar.d  develcpJher.t  of  aircraft  envir(ie.i«ental  systems  have  been  largely 
inadequate  because  of  the  lack  of  suitable  quantifiable  data  describing  hunan  performance  changes 
under  high  cabin  taupe ratures .  It  was  the  purpose  of  this  study  to  explore  techniques  which  could 
provide  this  quantifiable  information  and  to  assess  actual  pilot  performance  in  a  hot  nnviroivnent. 

A  prototype  (JI-6A  helicopter  was  instruaented  as  the  test  vehicle.  Four  experienced  pilots  flew 
precision  air  patterns,  observed  and  recorded  ground  targets,  and  performed  normal  flight  duties 
of  monitoring  flight  and  engine  instruments  and  other  tasks  during  two-hour  flight  test  periods. 
Four  separate  clothing  configurations  were  worn  by  the  pilots  during  the  study. 

Ckiring  each  flight  two  observers  simultaneously  measured  pilot  physiological  and  psychological 
performance  as  well  as  the  crew  station  environment.  The  physiological  performance  was  measured  by 
lieart  rate,  skin  and  rectal  temperatures,  and  perspiration  weight  loss.  Measures  of  psychological 
performance  were  defined  as  photopanel  exposures  of  the  instrument  panel  during  precision  flight 
patterns,  respon- e  and  reaction  time  measures,  grounJ  target  identification,  and  assessments  of 
subjective  comments  during  post-flight  debriefings,  both  airborne  and  ground  environmental 
measures  of  Dry  Bulb,  Wet  bulb  and  Globe  Temperature  were  taken  to  determine  the  Wet  Bull)  Globe 
Temperature  (WBGT)  Index  of  heat  stress,  which  provided  a  base  by  which  pilot  performance  changes 
were  compared. 

Stepwise  multiple-regression  program,  Pearson  correlation,  analysis  of  variance  and  t  tests  of 
significance  were  employed  on  the  data  to  describe  the  relationships  of  temperature  changes  with 
pilot  performance  factors.  The  following  statements  generally  si»mari2e  the  results  of  the  study: 

1.  Pilot  performance  tP^)  decreased  and  performance  variability  (SD)  increased  above  a  WBGf 
Index  of  8S*F. 

2.  The  predictor  performance  equations  determined  by  the  multiple-regression  program 
indicated  that  skin  anu  rectal  temperatures  were  highly  related  to  pilot  performance. 

J.  Pilots'  reaction  times  increased  as  either  ambient  temperatures  or  rectal  temperatures 
inersa.  cd. 

4.  Pilots  performer  (Pp)  better  when  they  encountered  light  to  moderate  aircraft  turbulence 
than  they  did  on  non- turbulent  flights. 

5.  Pilot  subjective  judgments  of  cabin  heat  were  highly  inconsisrent  with  environmental 
measurements . 

b.  Weight  loss  from  perspwation  appeared  to  tiave  a  positive  correlation  with  performance 

(Pi)  • 


7.  The  clothing  and  equipment  configurations  worn  by  the  pilots  (including  body  armor)  had 
no  significant  effect  on  their  performance  (Pi). 

8.  The  cabin  heat  did  not  significantly  affect  the  pilots'  ability  to  observe  ground  targets. 

9.  Large  differences  in  performance  (Pj)  variability  among  pilots  were  due  to  bas' --  nilot 
techniques  (regardless  of  experience) . 

10.  No  constant  rclatioashlp  could  be  determined  between  ground  and  airborne  measures  of  WBGT. 

Limited  aircraft  and  pilot  availability  allowed  only  four  subjects  to  be  used  during  the  study,  of 
which  two  completed  all  required  flights.  The  above  results,  therefore,  should  be  considered  only 
as  trends  for  the  subjects  and  conditions  tested. 

The  techniques  used  during  this  study  did  successfully  measure  both  a  large  portion  of  total  pilot 
performance  and  the  cockpit  environment.  The  multiple-regression  program  enabled  comparisons  of 
pilot  performance  and  environmental  sub-factors  on  large  volumes  of  data,  which  heretofore  would 
have  been  impossible.  Though  environmental  variables  could  not  be  controlled,  they  could  be 
accounted  for,  measured  and  correlated  with  other  variables  using  the  multiple-regression  program. 

It  may  be  hypothes i led  that  if  these  variublcs  con  be  accounted  for  and  correlated,  then  the  basic 
approach  of  inflight  measurement  of  hunun  performance  certainly  offers  the  potential  of  obtaining 
realistic  assessments  of  new  crew  station  designs  and  may  ultimately  be  the  best  approach  to 
developing  the  type  of  quantified  Information  needed  to  develop  crew  station  Jesign  criteria  and 
standards . 

In  conclusion,  this  study  provides  a  good  baseline  from  which  to  structure  future  inflight  research. 
Certainly,  the  techniques  employed  as  we  1 1  as  the  results  should  be  further  verified. 
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OBJECTIVF  . 


Tills  .study  was  undertaken  with  the  following  objectives: 


I  .  To  'determine  If  changes  In  pilot  physiological  and  psychologies!  performance  could  lie  detected 
and  correlated  with  changes  In  relatively  high  crew  station  ambient  temperature,  humidity,  and  solar 
radiation . 


2.  To  assess  quantitatively,  the  compatibility  of  pilots  wearing  complete  combat  flight  clothing  and 
survival  equipment,  with  a  new  (prototype)  Army  aircraft  system  operating  in  a  hot,  humid  environment. 

The  intent  ol  this  analysis  was  to  point  out  hardware  and  clothing  problem  areas,  if  existing,  and  make 
appropriate  corrective  design  recommendations  before  the  aircraft  became  operational. 

PROBLEM  BACKGROUND  Isolating  and  measuring  the  factors  contributing  to  pilot  fatigue  and 
efficiency  lias  cli.i'V-nued  the  scientific  community  since  aircraft  began  to  fly.  The  principal  question 
unanswered  has  been  to  what  degree  do  these  factors  contribute  to  or  cause  human  performance  decrements 
and  errors,  and  ultimately,  to  what  degree  should  they  he  considered  In  the  design  of  the  aircraft. 

Previous  Army  field  reports  have  suggested  that  one  of  the  most  significant  environmental  factors  contributing 
to  pilot  flight  performance  decrements  may  Ik-  the  combined  effect  of  high  temperature  and  humidity.  A 
search  of  related  literature*,  however,  indicates  Hurt  no  one  has  been  able  to  define  these  decrements  in 
sufficiently  precise  quantifiable  terms  to  verify  significant  performance  changes  or  fatigue,  or  to  establish 
adequate  criteria  for  the  design  of  aircrew  environmental  coiltro1  /ventilation  systems  (ECS)  and  related 
aircrew  elutliing  and  survival  equipment. 

The  design  and  development  of  ECS  hardware  has  by  necessity  been  determined  more  by  crewmembers’ 
subjective  opinions  anti,  to  some  degree,  by  what  the  airlramc  contractors  happened  to  furnish  as  "off-the- 
shelf"  hardware  and  systems  .  Unfortunately,  subjective  opinions  are  difficult  to  design  to,  are  unreliable 
regarding  estimates  of  heat,  and  in  general  do  not  provide  the  framework  of  data  needed  to  develop  crew 
station  design  standards  . 

There  is  a  tendency  to  rely  on  an  assumed  ability  of  the  aircrew  to  adapt  to  the  environment.  This  allows  the 
tradeoff  arguments  of  increased  costs  and  weight  to  dominate  the  design  of  the  crew  station,  to  the  neglect  of 
an  adequate  environmental  system. 

Tile  net  effect  of  this  design  approach  lias  been  lliat  Army  crews,  oi  order  to  compensate  for  inadequate 
cooling/venlilation,  make  field  changes  such  as  removing  the  doors  from  the  aircraft  to  provide  additional 
ventilation , 

Tile  increased  performance  capability  of  current  and  projected  Army  aircraft  (LOH,  AH-56A,  AH-1G, 

UTTAS,  etc  .)  however,  will  require  that  the  doors  and/or  windows  remain  in  place  lo  acliieve  the  full  aircraft 
flight  ixirformance  envelope.  Their  mission  requirements  will  require  flight  at  near  ground  levels  at  which 
reflected  solar  radiation  and  high  air  temperature  levels  will,  in  warm  climates,  likely  aggravate  the  crew 
heat  stress  problem . 


METHOD 

AIRCRAFT  AND  STUDY  SITE  .  A  prototype  light  observation  helicopter  (LOH,  0H-6A  no.  4211, 

Figure  1)  was  instrumented  as  the  test  vehicle  as  illustrated  in  Figures  2  and  3. 

Fort  Rucker,  Alabama,  was  selected  as  the  study  site  because  of  Its  capability  to  maintain  and  support  the 
aircraft,  availability  of  additional  personnel  needed  to  conduct  the  study,  and  a  favorable  climatological 
liistory,  which  indicated  that  relatively  high  temperatures  and  humidities  would  prevail  during  the  study  period. 
Predictions  were:  August  1966,  91°F  mean  maximum  temperature  with  70%  mean  Relative  Humidity  (RH); 
September  I960,  8H°F  mean  maximum  temperature  with  65%  Rll. 


See  Al'SCM  SO-.l  ( 12),  Handler  (4),  Jones  (6),  and  Joy  (7) 


Figure  1.  AIxav.  Takeoff  ol  prctoiype  Ol  I  ■  f>A  light  observation  heikojxer  (1.0!  I)  during 
environmental  study  at  I'ort  Kucker,  Ala.,  August  i 9it0 . 

lk~luw:  Aerial  view  ni  ground  target  v\  cniw ,  'Mu*  view  .shown  is  or.e  ul  twenty  target 
configurations  displayed  to  the  pilots  during  each  flight  ;is  an  observation  ft  reporting 


12-5 


SUBJECTS .  i  . » ■  i  Hilly  qualified  Army  1.011  pilots  served  as  subjects.  Medical  and  personal  history 
data,  flight  experience,  and  anthropometric  measurements  ol  each  subject  were  rc.lev.ed  to  determine  tile 
selection  and  matching  between  subjects,  Th  pilot -subjects  had  similar  flight  exjvriinence ,  were  highly 
qualified,  highly  motivated  inst mclor  pilots. ami  as  permanent  residents  o!  the  lort  Rucker  area,  were 
acclimatized*  and  accustomed  to  flying  in  that  area.  Their  qualifications  tended  to  assure  that  learning 
effects,  performance  and  flight  variability  due  to  acclimatization  or  area  peculiarities  like  air  traffic, 
weather  conditions,  special  regulations,  etc.,  would  lx  minimized .  S'o  attempt  was  made  to  control  or 
change  the  living  patterns  of  the  pilots  during  the  course  of  the  study.  All  were  family  men  and  enjoyed 
normal  work  ar.d  home  activities.  They  were  asked  to  lx  rested  and  not  to  fly  other  aircraft  the  day  they  were 
to  fly  as  subjects  . 

PILOT  -SUBJECT  PLIGHT  SCHEDULE  AND  CLOTHING  MATRIX.  The  pilot  flight  clotlilng  and 
survival  configurations  A,  II  and  C,  illustrated  in  Tigure  4,  were  considered  representative  of  what  Army 
aviators  are  currently  wearing  and  will  lx-  wearing  in  the  near  future.  They  were  worn  by  the  subjects  during 
the  study  to  duplicate  the  thermal  insulation  effects  of  operatic  nil  clothing  and  equipment .  The  ventilated 
clothing  configuration  D  (ITgure  4)  was  added  to  the  study  for  an  assessment,  rather  than  as  part  of  the 
experimental  design. 

I  lie  experimental  design  for  the  study  required  each  subject  to  serve  as  bis  own  control .  \  total  of  1 1  flights 

| xt  pilot  was  scheduled  two  in  the  morning  plus  nine  in  the  afternoon.  Eleven  flights  appeared  to  lx-  adequate 
to  sample  the  temperature  region  of  concern  (WBGT  range  of  MinE  through  IOO°l;).  The  subjects,  flights  and 
clothing  configurations  were  assigned  according  to  a  random  -number  mat>  ix  to  minimize  experimental  bias 
factors . 

AM  flights  were  scheduled  for  one  hour  and  PM  ftights  for  two  hours.  The  AM  flights  were  to  lx-  completed 
during  the  hours  of  t)5.U)-t)9(M),  to  obtain  a  level  of  pilot  performance  during  cool  or  more  Ideal  temperature 
conditions  (WBGT <C  K.V’E,  hut  preferably  within  a  range  7l>-.V>°!:).  Theoretically,  it  would  have  Ixcn  desirable 
to  duplicate  two-hour  AM  flights  for  each  two-hour  PM  flight  flown,  but  this  approach  had  to  lx-  nlvundened 
Ix-cause  it  was  impossible  to  guarantee  su  fficient  pilot  and  aircraft  availability  or  to  control  ambient  environ¬ 
mental  temperatures .  On  the  other  hand,  there  appeared  to  lx-  considerable  evidence,  both  in  the  literature 
and  from  trial  flights  Ixfore  the  start  of  the  study,  to  substantiate  that  no  more  than  one -hour  AM  flights 
were  needed. 

I  .  Previous  studies  by  llornick  (5),  U.  S.  Army  (IB),  and  others  indicate  that  measures  o'  pilot 
flight  performance  (aircraft  heading,  altitude  and  airspeed  control,  navigation,  etc  .)  indicated  that  here 
were  no  effective  performance  decrements  or  indications  of  fatigue  during  flights  up  to  four  hours  duration, 
in  a  h.w  altitude  high  speed  flight  simulator  (operating  with  an  assumed  constant  cool  room  temperature). 

These  simulator  flights  also  exposed  the  pilots  to  random  gusts  and  vibrations  up  to  .4RMS  G  and  1-12  CPS. 

2.  Trial  flights  of  1-2  hours  in  the  prototype  OII-6A  before  the  start  of  the  study  indicated  that  pilot 
jxwformancc  (P|)  seemed  to  level  off  within  one  hour. 

Pile  pilots'  physiological  responses  were  not  expected  to  change  significantly  from  the  normal 
classical  form  during  cool  flights:  i.c.,  some  deviations  at  the  beginning  of  the  flight,  then  gradually 
returning  to  a  normal  state. 

Two-hour  PM  flights  were  selected  to  enable  ample  time  for  physiological  changes  to  occur,  as  has  Ixvii 
demonstrated  by  studies  of  Ilemller  (4),  DuBois  (2)  and  others.  These  flights  were  to  lx  completed  during 
I  he  hours  of  1 0110-1 0(H>,  to  utilize  the  period  of  highest  temperatures  (WBGT  >  Ss°l:)  in  the  Port  Rucker  area. 

PILOT  PERFORMANCE  AND  PHYSIOLOGICAL  OBSERVERS.  During  each  flight  two  observers 
(usually  noil-pilots)  olxained  simultaneous  pilot  physiological  and  psychological  performance  and  crew  station 
environmental  measures  .  Pliev  also  assisted  ill  the  instrumenting  and  weighing  of  the  pilots  on  the  ground, 
and  conducted  post-flight  pilot  debriefings. 


Previous  work  by  Ilemller  (  I)  suggests  that  performance  measures  taken  on  acclimatized 
not  lc  as  sensitive  to  daily  fluctuations  of  temperature  and  Inimidilv  as  non  -acclimatized 


ixrsonnel  would 
jx-  r sonne  I  . 


ijrurc  4.  Clothing  Coni 
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The  observers  wore  also  required  to  closely  monitor  the  pilot's  physiological  condition  Inflight;  primarily 
because  no  safely  pilots  were  useu  during  liie  flights  anu  tiie  fact  tiuit  infiigiit  iicui  stress  e-Ajnrsure  euuid  not 
be  accurately  predicted.  The  following  predetermined  pilot  physiological  safety  limit  criteria  were  used  If 
a  Judgment  to  cancel  the  flight  was  necessary: 

1.  Any  heart  rate  above  140. 

2 .  If  heart  rate  at  takeoff  was  less  than  100,  the  flight  was  to  be  terminated  If  the  heart  rate 
increased  to  120. 

3.  Any  rectal  temperature  exceeding  100. 5°F  . 

4.  If  starting  rectal  temperature  was  less  than  19 . 5°K ,  the  flight  was  to  be  terminated  if  the 
temperature  exceeded  UKJ.0°f- . 

.S,  In  all  cases  the  flight  was  to  lx-  terminated  If  the  rectal  temperature  exceeded  100. S°l- . 

A  flight  surgeon  was  also  available  for  consultation  via  radio  link,  if  required,  Frequently,  a  flight  surgeon 
llcw  on  the  flights  as  tin*  physiological  observer . 

GROUND  CKKW  .  A  ground  crew  was  also  required  lor  each  flight  to  periodically  change  the 
configuration  of  the  ground  target,  measure  ground  level  meteorological  conditions,  and  occasionally 
monitor  the  pilot  physiological  data  which  was  either  communicated  or  telemetered  to  the  ground  station  . 

They  also  prepared  the  next  pilot -subject  ahead  of  schedule  to  minimize  flight  turn-around  time. 

PSYCHOLOGICAL  PLR FORMA  NCii  MbAbUKhMLNf  AND  hQUlPMKNP. 

Precision  F  Light  Pattern .  A  precision  flight  pattern  entitled  13RAVO  (Figure  5)  was  flown  to  oteain 
measures  of  pilot  psychomotor  flight  tasks.  No  safety  pilot  was  carried  in  the  aircraft;  therefore,  the  piiot 
had  to  fly  the  pattern  as  well  as  perform  the  pilot's  normal  duties  of  monitoring  flight  and  engine  Instruments, 
fuel  management,  communications  and  other  tasks.  These  normal  duties  appeared  to  be  similar  to  the 
concentration,  decision  making  and  aircraft  control  activities  anticipated  for  pilots  flying  LOll  missions. 

The  BRAVO  pattern  was  derived  from  the  U.  S.  Navy's  "Charlie"  pattern,  used  during  WW  II  to  train  pilots 
to  fly  instruments  and  qualify  for  the  Standard  Navy  instrument  card  .  A  further  discussion  of  the  pattern 
may  be  found  in  the  Navy  All-Weather  Flight  Manual  (16). 

Flying  the  BRAVO  pattern  during  this  study  was  not  considered  as  complex  as  flying  by  instruments  alone, 
mainly  because  the  pilot  was  allowed  to  sec  out  of  the  aircraft  to  cross-reference  his  flight  instruments.  The 
performance  criteria  for  the  BRAVO  pattern,  therefore,  appeared  achievable  and  realistic  us  a  performance 
measure  for  this  study. 

A  movie  camera  was  mounted  in  the  aircraft  (Figure  2)  to  take  pictures  of  the  flight  instrument  panel  at  the 
rate  of  one  frame  per  second  (shutter  speed  of  1/250  second)  during  each  BRAVO  pattern  fluwn.  A  tum-and- 
bank  indicator,  sweep  second  timer  and  clock  were  installed  (Figure  2)  for  the  pilot  and  performance  observer 
to  use  during  each  flight  pattern  . 

Observation  of  Ground  Targets.  The  pilot  -subject  was  given  an  inflight  task  of  periodically  observing 
anil  recording  the  configuration,  observation  time,  and  orientation  of  a  ground  target  (Figure  1),  while 
simultaneously  flying  the  BRAVO  pattern  (Figure  5).  The  target  was  painted  International  fluorescent  orange, 
wltich  made  it  distinguishable  at  an  expected  slant  range  of  two  miles  at  an  altitude  of  800  ft. ;  it  was  identifiable 
at  just  under  a  mile.  Pilot  performance  scoring  was  accomplished  after  the  flight  by  comparing  the  ground 
crew's  log  with  the  pilot's  written  observations  . 

Rcsponse/Reaction  Time  Measures.  The  pilot’s  response  and  reaction  times  were  measured  30  ro 
40  times  during  each  flight.  To  accomplish  the  reaction  time  measurement,  the  pilot  was  alerted  ahead  of 
time  that  lie  was  to  receive  a  continuous  tone  2000  CPS  signal  in  his  headset.  At  the  onset  of  tin*  signal,  the 
pilot  responded  by  pressing  the  trigger  switch  on  his  cyclic  control,  which  stopp'd  the  signal  and  an  elapse 
timer  accurate  to  1/100  second.  The  2000  CPS  signal  was  selected  because  it  was  not  masked  by  the  aircraft's 
ambient  noise  levels,  because  it  did  not  resemble  any  existing  aircraft  signal  or  interfere  with  normal  or 
emergency  signals,  and  because  it  did  not  interrupt  communications. 


PERFORMANCE  CRITERIA; 

1 .  Hold  Heading  within  ^5° 

2.  Hold  Altitude  within  -50  ft. 

3.  Hold  Airspeed  within  -5  knots 

■1 .  Fly  Precision  Timed  Turns  of  3°  per/sec  . 
within  t2  seconds  accuracy 


Figure  5. 


BRAVO  Precision  Flight  Pattern 
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The  response -time  measures  were  taken  the  same  way,  except  that  the  pilot  did  not  receive  any  prior 
warning  of  the  sianoi  In  lyah  cases  the  pile;  •.van  engaged  ir.  u  jo  O  nui  y  iu o f.  oi  I'iying  tiie  aircraft,  wmen 
required  his  right  hand  to  be  on  the  cyclic  control.  Figure  2  illustrate::  the  control  box  which  the  performance 
observer  used  during  each  flight  to  control  the  camera,  elapse  timers  and  pilot  response  time  signal . 

Post  Flight  Debriefing.  The  pilot  was  debriefed  after  each  illvlit  for  an  appraisal  of  the  environmental 
conditions,  the  clothing  and  survival  equipment  worn,  and  other  flight  conditions.  Selected  questions,  which 
encouraged  objective  answers,  were  grouped  on  separate  cards  and  given  to  the'  pilot  to  read  and  answer. 

All  Ids  comments  were  tape  recorded. 

The  pilot  interview  was  considered  structured  but  open-ended.  The  interviewer  remained  silent  during  most 
of  the  recording  to  minimize  any  hissing  of  the  pilot's  responses  to  the  questions  .  The  pilot,  In  turn,  was 
free  to  select  question  cards  in  any  order  of  Importance  to  him  and  could  spend  as  much  time  as  he  wished  to 
respond  to  the  questions  . 

PHYSIOLOGICAL  MEASUREMENTS  AND  EQUIPMENT. 

Heart  Rate  .  Measurement  of  the  pilot's  heart  rate  was  taken  by  the  physiological  observer  before, 
during  and  after  each  flight .  Two  silver  electrodes  were  applied  to  the  skin  of  the  pilot's  chest  at  the  sternum 
(Figure  6).  Two  wire  leads  (reference  and  recorder)  connected  the  electrodes  to  a  ha ttery- powered 
oscilloscope  and  to  a  small  (3  i/2  lb.)  electrocardiographic  recorder  (Figure  3).  The  observer  manually 
recorded  pilot  heart  rate  readings  from  observations  of  the  oscilloscope  every  five  nv.nutes .  The  portable 
recorder  made  a  continuous,  permanent  heart  electrocardiograph  record  which  was  analyzed  after  each  flight . 

A  "breadboard"  portable  telemetry  unit  was  Installed  in  the  aircraft  to  assess  the  capability  of  the  hardware 
to  transmit  both  an  electrocardiograph  signal  of  the  pilot’s  heart  rate  and  the  rectal  temperature  (Figure  6). 
The  system  was  Installed  as  a  redundant  heart  rate  monitor,  primarily  for  test  purposes. 

Body  Gore  temperature .  A  rectal  thermistor  probe  worn  by  the  pilot  during  each  fllgiit  was  wired  to 
the  temperature  display  at  the  physiological  observer's  station  (Figure  3)  to  enable  is; light  body -core- 
temperature  measurements  every  five  minutes  . 

Skin  Temperature.  One  skin  temperature  sensor  was  worn  on  the  inboard  position  of  tile  upper  tlilgh 
of  the  pilot  during  each  flight.  Studies  by  Teleluier  (li)  indicated  that  one  sensor  placed  in  tills  position 
could  provide  an  overall  assessment  of  mean  body  surface  temperature.  A  wire  from  tile  sensor  was 
connected  to  the  temperature  display  at  the  physiological  observer's  siation  (Figure  3)  to  enable  Inflight 
readouts  every  five  minutes. 

Weight  Loss.  Tiie  pilot -subjects  were  welgheu  nude  just  before  and  after  each  flight  to  determine 
possible  weight  losses  due  to  perspiration.  The  scale  was  accurate  to  tiie  nearest  five  grains  (approximately 
.01  lb.). 

AIRBORNE  ENVIRONMENTAL  MEASURES.  Wet  Bull)  (WB),  Dry  Bulb  (DB)  and  Globe  Temperature  (GT) 
thermisters  were  positioned  In  the  c.^spit  just  forward  of  the  pilot  (Figure  2).  Additional  DB  sensors  were 
mounted  at  the  crown  of  the  co-kpit,  shaded  from  the  sun,  and  at  two  locations  on  the  physiological  observer’s 
seat  (passenger  compartment). 

A  Wet  Bulb  Globe  Temperature  (WBGT)  Index  was  used  as  the  overall  measure  of  the  total  beat  stress  imposed 
on  the  subjects.  WBGT  index  i.;  computed  as  follows,  as  per  Tl)  MED  175  (14): 

WBGT  =  0.7  Wet  Bulb  Temperature  f°l;) 

+0,2  Black  Globe  Tcm|)craturc  (°F) 

+0.i  Dry  Bulb  Temperature  (°F) 

Environmental  measures  were  taken  simultaneously  with  physiological  measures  at  least  every  five  minutes 
of  flight . 

GROUND  METEOROLOGICAL  MEASURES.  WB,  DB  and  GT  measures  were  taken  on  the  ground 
immediately  before  and  after  each  flight  to  obtain  comparative  measures  of  WBGT  lor  each  flight.  Measures 
of  WB  and  DB  were  also  taken  periodically  with  an  electric  psychrometcr  as  a  cross  -check  on  the  temperature 
measures  taken  for  the  WBGT  Index  .  Standard  Relative  Humidity  (Kll)  was  computed  from  the  psychrumeter 
data . 
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The  official  DB,  Dew  Point  (DP),  wind  and  cloud  cover,  as  reported  by  the  Fort  Rucker  (Cairns  Field)  Flight 
Meteorological  Services,  were  recorded  f nr  flight  ac  a  ..mao -reference  lor  mca— ires  obtained  by 

the  study  team . 

DATA  REDUCTION  AND  ANALYSIS  All  physiological  and  psychological  performance  measures  taken 
on  each  pilot -subject  were  obtained  simultaneously  with  the  crew  station  environmental  measures. 

A  photopanel  exposure  was  made  oi  the  flight  and  engine  Instruments  every  second  during  each  16-mlnute 
BRAVO  flight  pattern.  Usually,  two  or  three  patterns  could  be  flown  during  each  hour  of  fliglit.  This  data 
was  reduced,  recorded  and  compared  to  pilot  physiological  and  psychological  performance  and  environmental 
measures  taken  approximately  every  five  minutes  of  fliglit.  Because  of  the  large  volume  o(  information 
generated  during  the  study,  a  pilot  study  was  initially  performed  In  which  different  time  Intervals  of  collected 
data  were  sampled  to  determine  the  degree  of  performance  changes  and  trends  during  these  Intervals.  Ten- 
second  Intervals  were  selected  as  optimum  for  the  photopanel  data ,  Extrapolations  were  mode  between  the 
five  -minute  Intervals  of  data  collected  from  the  physiological  and  environmental  measures  to  olgaln 
corresponding  lnlormation  lor  each  ten -second  photopanel  time  frame. 

For  the  purpose  of  recording  and  processing  the  data,  this  time  frame  was  Identified  as  a  "line  entry A 
line  entry  represented  all  inflight  performance,  physiological  and  temperature  measures  recorded  .it  leu- 
second  intervals  during  each  16-minute  BRAVO  flight  pattern. 


An  equation  was  devised  to  represent  on  overall  measure  of  pilot  performance  while  he  was  accomplishing  his 
primary  task,  flying  the  BRAVO  pattern.  This  performance  value  could  then  he  compared  with  the  physiological 
and  environmental  measures  occurring  in  the  same  time  frame .  The  following  formula  was  developed  for 
computing  the  measure  of  pilot  performance  (P[)  for  each  lino  entry  of  the  flight  data: 

Pj  ■*  100  -  (absolute  airspeed  error  +  absolute  altitude  error  + 

absolute  heading  error  +  absolute^  torque) 

where  100  =  an  arbitrary  scoring  value  for  perfect  performance .  The  absolute  (a be.)  values  were  obtained  by 
comparing  the  following  precision  flight  requirement  values  with  the  actual  aircraft  values  achieved; 


Airspeed  (A/S) 
Altitude  (alt) 

Heading  (hdg) 
Torque 


80  knots 

800  feet  absolute  altitude  (1 100  feet  indicated  altitude  at 
Fort  Rucker,  Ala.) 

as  per  the  BRAVO  flight  pattern  (Figure  5) 
the  absolute  difference  of  the  value  of  present  lorquc  and  the 
previous  value  oi  torque  for  any  two  sequential  lime  periods . 
In  the  special  case  of  the  Initial  value  of  torque  for  each 
pattern  ..A.  torque  was  the  absolute  difference  between 
SO  PSI  and  the  value  of  torque.  The  value  of  50  was  chosen 
as  respresentative  of  a  realistic  power  setting  for  the 
aircraft  and  flight  conditions.  A  variation  of  -2  PSI  was 
considered  normal  for  the  power/load/airspeed  operation  of 
the  OH -6 A  during  the  BRAVO  pattern  . 


The  numerical  version  of  the  formula  for  measurement  of  performance  Is  as  follows: 

Pj^  =  100  -  abs  (80-A/S)  -  abs  (1100-alt)  -  abs  (hdg  error)  -  abs  ( A  torque). 

The  term  "with  limits  applied"  as  used  In  this  report  references  a  variation  of  the  Pj  value  which  has  been 
computed  with  the  tolerances  allowed  by  the  BRAVO  pattern  performance  criterion  (Figure  5).  The  turn 
"without  limits  applied"  describes  the  actual  performance  (Pj),  discounting  the  performance  criterion 
tolerances . 
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To  rnal»ii-  .1  u«»im|xi n>mi  •  i!h-  !*  v  lunge-  with  i  hiinjn-^  in  physiological  and  enviiomncntnl  v,-t  rl.iblus,  the 
data  w.is  organ j/.t-il  in  .1  form  Lu  enable  l  Ik*  .m.ilysi  in  mniv  «•«••»<  *%(  »nv  !.<iinn.ii'ii  «.  -»  (Hlu.) 

Stejnvise  Multiple  Regression  Computer  Program  developed  hy  Breaux,  et  al .  (1).  Thu  candidate  model 
(‘filiation  used  by  this  program  considered  all  variables  m  the  fifth  power  anti  then  eliminated  those  which  did 
not  meet  tile  criteria  of  .1  .001  Jcvcl  of  sleniiicfimv  -  Tiv  muma-io.  mode!  fyr  t!’.'::  cJipcrlim  nl  riU-u 

as: 


I’  ■  VI  t  a  ,va  i-  a2V22  +  o  ,V2 *  +  a.,V24  +  asV2s  *■  a,V3  t  n.,V32  I  f  n^V.r*  t V:)5 


.  .  .  anVl<>\ 


where: 


Factors 


Reference-  L’reraturc 
Source  of  Standards 


VI  = 

Constant 

Breaux,  Campbell,  Torrcy  (1) 

V2  = 

73  -  Wut  Bulb  Temperature  Value 

AF'SCM  HO-3  (12) 

v:j  = 

100  -  Globe  Temperature  Value 

AF'SCM  SO-:)  (12) 

V4  = 

90  -  Dry  Bulb  Temperature  Value 

AI-SCM  Hll-.l  (12) 

V5  = 

HS  -  WBGT  Index  Value 

Mbmrd  (H),  Yagluii  (17) 

V6  - 

98. 9  -  Rectal  Temperature  Value 

DuBois  (2) 

V7  = 

94.5  -  Skin  Temperature  Value 

Hull  &  Klcnn  (1),  Diillois  (2) 

V8  = 

Base  Heart  Rate -Heart  Rate  Value 

Plattner  (10) 

V9  » 

69  -  Dew  Point  Temperature  Value 

AFSCM  SO -3  (12) 

V10  = 

7U  -  Relative  Hun: idity  Temperature  Value 

AF'SCM  SI  1-3  (12) 

From  the  camliUate  model  equation,  the  program  derived  an  equation  which  provided  the  above  variables 
(V 1  -  10)  with  the  proper  exponents  and  coefficients  to  lx-st  describe  (or  lx-st  lit)  tile  ix-rforimuicc  shown  by 
the  pilots  ,  Tliis  program  also  provided  a  value  lor  each  I  me  entry  of  pcrfurmuncc  as  given  (l’|)  and  as 
computed  using  the  equation  derived  by  the  program  (I’2).  I  lie  difference  between  the  value  of  I’]  and  P2  was 
known  as  the  residual  value.  Theoretically,  the  ideal  residual  equaled  zero,  thereby  substantiating  the 
predicting  capability  of  the  derived  equation  1’2 

Computer  analysis  rims  were  made  to  determine  the  "best  lit"  performance  equation  1’2,  Ixith  with  and 
without  crew  porformance  limits  applied  for  tile  following  cimditious:  1)  AM  flights,  2)  I’M  flights,  ,1)  All 
flights,  and  -1)  those  fliidits  having  a  WBGT  index  higlier  than  X.v’F. 


Tlx-  computer  was  aiso  rogrammed  to  provide  means  standard  deviations,  frequency  counts  and  the  values 
of  N  for  other  computations  which  were  to  lx-  |x-rformed  manually  lor  the  study. 


RESULTS  AND  DISCUSSION 

MEASURES  OF  PILOT  PERFORMANCE  WITH  TEMPERATURE  CHANCES.  Measured  data  from  all 
flights  with  a  WEST  Index  of  greater  than  85"F  were  grouped  together  as  "hot"  [lights  ami  compared  with 
other  flights  by  time  pc-ritxis  (Table  1). 


' 

Flight  Time 
Periods* 

Mean  !>erf.(P,) 

(all  subjects) 

Sigma 

Total 

Plights 

Line 

Kntries 

Morning 

85.94 

20.32 

•t 

6:2 

Afternoon 

87 .  53 

— 

2  1 

76 

4452 

s'.  iy() 

1  | 

6 

24 

IN81) 

87.33 

22.785 

25 

83 

5064 

TABLE  1  .  Comparison  of  Pilot  Performance  <  n  ilot  Flights  with  Other  Flights 


Table  .(  provides  a  summary  of  crew  station  temperatures  associated  with  each  flight  lime  period 
listed  hi  I  abie  1 . 
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Even  thougn  no  significant  difference  In  performance  was  found,  the  above  data  sample  clearly  suggests 
that  when  the  WBGT  Index  increases  above  85°F,  performance  decreases  and  variability  Increases  . 

The  change  in  performance  with  temperature  changes  was  even  more  apparent  when  the  mean  performance 
flight  data  of  pilots  L  and  C,  who  completed  all  required  flights,  were  compared  with  WBGT  Indexes  which 
were  either  greater  than  or  less  than  8S°F: 

Mean  Performance  (WBGT  >  85°F,  1695  line  entries)  =  80.99 

Mean  Performance  (WBGT  <  85°F,  4159  line  entries)  =  89.00 

All  flights  were  reviewed  to  determine  associated  temperatures  when  pilot  performance  (Pj)  fell  below  an 
arbitrary  value  of  50.  Table  2  summarizes  mean  temperatures  from  four  flight  patterns  in  which  the  mean 
low  Pj  =  42.44  and  the  flight  having  the  lowest  performance  score  of  35.83. 


Pj  v 42.44 

Pj  =  35.83 

WB  =  V6.8 

GT  =  110.4 

DB  s  100.5 

RT  =99.5 

WBGT  =  85.9 

WB  =  94.4 

GT  =  118.6 

OB  =  103.1 

RT  =  99.9 

WBGT  =  98.1 

TABLE  2.  Associated  Temperatures  when  Pilot  Performance  (P^)  Fell  Below  50. 

Of  the  days  in  which  both  AM  and  PM  flights  were  scheduled  and  flown  by  the  same  pilot,  wearing  the  same 
clotlting/equipment  configuration,  only  one  day's  matching  of  flights  yielded  enough  performance  data  to  be 
reportable  --  the  rest  were  incomplete  because  of  weather,  inadequate  film,  flight  cancellation,  etc. 

Table  3  summarizes  the  flight  performances  versus  temperatures  for  pilot -subject  C,  wearing  the  same 
clothing  configuration,  flying  both  an  AM  and  PM  fiight  on  4  September  1966. 


AM  Flight  No.  IB 

PM  Flight  No.  20 

Mean 

Perf .  (P  j ) 

Perf. 

Var.(SD) 

_ 

Mean 

WBGT 

Mean 

Perf.(Pj) 

Perf. 

Var.(SD) 

Mean 

WBGT 

r_ 

Flrst  Flight 

Pattern 

84.54 

85.42 

19.18 

82.1 

Second  Flight 
Pattern 

89.25 

12.81 

80.8 

80.77 

22.71 

83.2 

IBK3B 

i 

86.52 

lomii 

84.05 

82.45 

TABLE  3.  Comparison  of  Pilot  Performance  and  Environmental  Temperatures 

for  Matched  Flights 


Though  one  sample  of  data  (Table  3)  cannot  be  used  to  predict,  it  dees  relate  to  other  findings  (Tables  1,  2 
and  6)  showing  a  tendency  toward  a  decrease  in  pertormanec  as  temperature  increases  and  an  Increase  in 
performance  variability  as  temperature  increases. 

Table  4  provides  an  overall  listing  of  some  of  the  inflight  measured  performance  and  temperature  data 
summarized  from  each  flight  flown  during  the  study. 
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MORNING  FLIGHTS 

Fit  . 

No .  Scored  A/S  Alt . 

atid  Fit.  Line  Perf?  Error# Error* 

Pilot  Patterns  Entries  (P , )  (knots)  (feet) 

Heading 

Error* 

(degrees) 

Wet 

Delta  Du  It 
Torque*  Temp. 
(PS1)  °F 

Globe 

Temp. 

°F 

Drv 

Doll) 

Temp. 

°t 

WBGT 

Index 

°1; 

Rectal 

Temp. 

!• 

1C 

i 

74 

76.77 

3.00 

1  .29 

36.98 

1 .67 

67.85 

92.43 

82  . 4  o 

74  .23 

99.2.3 

6L 

2 

188 

79.11 

2.62 

2.01 

31  .83 

1.42 

77.29 

99.55 

93.13 

83.32 

99.36 

ISC 

2 

ISO 

u6  *52 

2.8!) 

l  .Ho 

21  .28 

2.18 

74.72 

VM  .  0 1 

86.73 

79.70 

99.30 

21L 

2 

170 

96.88 

,66 

1  .  18 

7.22 

3.03 

73.58 

44.84 

HH  ,KK 

79.36 

98  .89 

AFTERNOON  FLIGHTS 

*  7C 

5 

366 

55.54 

4.04 

2.06 

57.43 

1  .82 

77.53 

111 .60 

100.66 

80  .05 

99.19 

*  9L 

4 

338 

93.49 

1 .72 

1.65 

11.92 

3.16 

9.1.15 

110,92 

98  .71 

97.26 

99.50 

•10C 

4 

29S 

75.79 

2.84 

.55 

34.91 

2.51 

92.36 

1U0.93 

97  .96 

9S.H.3 

99.. 31 

•UB 

2 

185 

83.09 

1  .75 

2.82 

27.95 

1 .92 

100.16 

97  .02 

90.62 

99.85 

•ISC 

5 

375 

85.76 

2.51 

1.94 

21.31 

2  .79 

78.05 

1  l-l  .yi) 

101  .41 

87.75 

98.90 

•  16L 

4 

321 

96.05 

2.47 

i  .  60 

5.  (.8 

3.18 

76.29 

109.4.1 

11U)  .1)4 

85.30 

99.66 

2G 

2 

189 

91,31 

4.06 

2.99 

18.80 

4.U4 

69.91 

102 .69 

41  ,51 

78  .62 

99.69 

3C 

0 

Cancelled  because  of  aircraft  malfunction. 

4L 

2 

207 

92.40 

2.61 

3.50 

1 1  .61 

2.91 

73.95 

10K  .91 

97  .04 

8.1 .25 

99.02 

SC 

4 

258 

61 .49 

2.74 

2.04 

55.92 

1.64 

71.84 

103.38 

98  .54 

82  .91 

99.47 

8L 

0 

Cancelled  Ixcause  of  rain. 

12L 

4 

.143 

91.91 

1  .81 

1  .83 

14.56 

3.4.8 

74.45 

109.73 

99.18 

KB  . 9.X 

99.26 

13C 

4 

334 

90.76 

2.24 

1.4b 

15.05 

2.09 

74  .40 

102.72 

99  .  [8 

82  .54 

98.26 

14L 

3 

260 

97.52 

1 .50 

1.66 

6.05 

2.12 

74.37 

107 .86 

100.60 

83.69 

99.72 

I7C 

1 

HO 

76.31 

2.78 

2.00 

31.89 

2.71 

73.69 

96.44 

94  .85 

80.35 

99.50 

191. 

4 

309 

95.71 

2.68 

2.20 

6.71 

4.48 

75 . 63 

101 .82 

92.97 

82  .60 

99.26 

20C 

2 

251 

84.05 

.3.27 

2.57 

25.74 

2.43 

74.14 

104.98 

95.44 

82  .43 

99.22 

22L 

0 

Incomplete  performance  data  Ixeause 

of  movie  camera 

malfunctl 

>1)  . 

23C 

3 

237 

84.14 

2.39 

1.7b 

23.87 

2.88 

73.49 

107.93 

96.81 

82  .71 

99.04 

24L 

4 

340 

97.40 

1  .00 

1.25 

4.25 

.3.61 

74.45 

111 .  19 

101  .73 

84  .53 

99.8  1 

25B 

S 

373 

73.06 

1.83 

1.46 

42.36 

1 

70.68 

105.19 

98  .50 

80.37 

99.7(1 

26L 

4 

340 

97.38 

.62 

1 .  12 

4.42 

3.89 

72.34 

100.06 

92.05 

79.8.8 

99.29 

27C 

3 

266 

81.3!) 

3.05 

2.73 

22.24 

2.48 

70.19 

105. ^8 

94  .72 

79.76 

99.30 

2RL 

■1 

322 

95.70 

2.91 

!  .65 

5.24 

4.82 

71.10 

1 1 1 .02 

99 . 75 

si  .ys 

99.43 

2913 

? 

342 

77.32 

3.03 

1.45 

34.02 

i  .76 

69.44 

99.74 

94  .49 

78.00 

99.67 

*  Indicates  Hot  I Tights 

>  85" 

F  WBGT 

£  With  Performanc 

e  Limits  Applied. 

TABLE  4.  Means  of  Performance  and  Environmental  Measures 


CORRELATION  (r)  OF  PILOT  PERFORMANCE  FACTORS  WITH  PHYSIOLOGICAL  AND 
ENVIRONMENTAL  TEMPERATURES.  Individual  pilot  performance  measured  during  the  study  was  compared 
with  recorded  WBGT  Index  and  physiological  measures  occurring  simultaneously.  Tables  5  and  6  summarize 
the  resulting  correlation  (r)  values  for  each  pilot. 

Significant  differences  from  zero  were  determined  at  the  .01  and  .Oh  level  for  each  pilot  using  the  means  of 
repeated  measures  from  each  flight  pattern  (Tables  5  and  6). 

A  search  of  the  literature  did  not  provide  a  clear  basis  to  make  a  valid  assessment  of  the  importance  of 
physiological  correlation  values.  Values  of  r  =  .1000  for  example,  may  lx-  quite  signilicaut  in  view  of  the 
fact  that  a  small  change  in  Rectal  Temperature  can  lie  critical.  The  results  might  lx  interpreted  as  trends 
and  many  appear  to  produce  the  expected  results.  For  example: 

1  .  For  all  subjects,  WBGT  appeared  to  have  a  positive  correlation  with  heart  rate  (Table  5).  This 
positive  correlation  would  have  Ixjen  predictable  according  to  results  reported  by  DufJojs  (2),  Hall  (.1)  and 
others . 
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2.  The  negative  correlation  between  performance  and  WBGT  fni-  pilots  i  i».i  r  {Tchlo  i)  might  be 
considered  a  trend  since  these  pilots  flew  the  most  flights  and,  therefore,  represented  a  larger  sample  of 
behavior . 


three  of  the  four  subjects  showed  a  negative  correlation  between  performance  anti  skin 
temperature  (Table  5).  The  strong  r  of  -.97  for  pilot  G  should  not  he  overinterpreted  because  it  represents 
only  one  flight  of  data. 


Comparative 

Pearson  Correlation  Values  (r>4 
for  Mean  Flight  Pattern  Scores 

Measures 

Pilot  L 
(n  =41) 

Pilot  C 
(n  =  35) 

Pilot  B 
(n  =  12) 

Pilot  G 
(n  =  2) 

l*ilot  Performance  (Pj) 
vs .  Skin  Tumix/raUm* 

.5031*’ 

-.0069 

- . 3467 

-.9730 

Pilot  Performance  (P.) 
vs .  Rectal  Temperature 

.078.3 

-.5453” 

- . 1 035 

.3145 

Pilot  Performance  (Pj) 
vs .  Heart  Kate 

-.4503** 

.0473 

_ 

.0124 

.3335 

WBGT 

vs.  Skin  Temperature 

.2072 

1 

.2520 

.2790 

-.3887 

WBGT 

vs .  Heart  Rate 

.3640* 

.8167** 

.9307*  * 

.6856 

WBGT 

vs.  Rectal  Temperature 

.2686 

.1588 

.8112** 

-.3754 

#  Calculations  are  based  on  summaries  of  data  obtained  for  each  flight  pattern  of  all  flights 
(Table  4)  tor  each  pilot .  Pilot  G  flew  only  one  flight . 

Minus  (-)  r  indicates  that  as  temperature  Increased,  performance  decreased. 

*  Significant  at  the  .05  level. 

••  Significant  at  the  .01  level. 


TABLE  5.  Correlations  of  Pilot  Performance  and  Physiological  Measures 


The  Pearson  correlation  analysis  of  performance  (lb )  and  temperatures  did  not  fully  substantiate  the 
predictor  equa:ion  results  determined  by  the  stepwise  multiple -regression  program  summarized  in  Tables 
7  and  8.  This  difference  probably  occurs  because  the  Pearsun  is  a  test  of  linear  relationships,  while  the 
multiple -regression  program  defined  a  curvilinear  relationship  between  ail  measures. 
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Measured 

Condition 

Pearson  Correlation  Values  (r) 
lor  Mean  I’Uglit  Pattern  Scori  s 

Pilot  1. 

<n  =  11) 

Pilot  C 
(n  =  35) 

mni  n  1 

(n  12) 

Pcrforniiim.'i.1  vs  ,  Wvt  Hull) 

-.0037 

-  ,  146  1 

.2334 

Clolx* 

.2039 

.;I440* 

.  0f)U2 

Dry  Bull) 

.2  198 

-  .227.3 

-.2141 

WIKIT 

-.  l.W 

- .  moo 

.  1 807 

Sigma  IV  iT.  vs.  VWt  Ikiih 

.247.9 

.11434 

-..3094 

HloU- 

-.2144 

- .0940 

.2574 

Dry  lliilb 

-.2249 

.  I3.SO 

.2220 

WUOT 

.  IIJS.S 

.0123 

-.2400 

Delta  A/S  vs .  WL-t  Hull) 

,(MN5 

.  20 1  u 

- .  2S.95 

CJ  lulv 

-.2.397 

.3103 

-.0204 

Dry  Bull) 

- . 232 1 

.0204 

-.2720 

WIKIT 

-  .1)757 

.24.34 

- .2457 

Delta  Alt.  vs.  Wvt  Bull) 

.OftlU 

-  .4455“ 

.U3f)4‘ 

Olulx/ 

.2.341 

.On  44 

- . 2432 

Dry  Bull) 

.0.32,1 

-  .  32  5  1 ' 

- .0344 

WIIGT 

.0814 

-  .  3380 4 

.  5f»U4 

Heading  Err. vs  .  Wet  Bull) 

.221.3 

.  If.  112 

-  .  2.39,3 

Globe 

-.2629 

.  1240 

.  1 502 

"  "  Dry  Bull. 

-  .2323 

.  23ud 

.  2U.3S 

WBCIT 

.0(ii)2 

.  IKUO 

-.  19.34 

Delta  Torque  vs.  Wet  Built 

1744 

.2047 

.04  do 

Globe 

..>940*’ 

.0706*  * 

.5741 

Dry  Unlit 

..3  143* 

.2549 

,f>7hy  ■ 

WBGT 

.0585 

.  .332  1  * 

.  1*83 

The  anticipated  correlation  (r)  re  Inti  unships  at  the  start  of  the  study  were  as  follows: 


Performance: 
Sienna  Peel  . : 
Airspeed; 
Altitude: 
Heading  Error: 
Delta  Torque: 


negative  value  of  r,  temperature  up,  performance  down . 
positive  value  of  r,  tenqxratutv  up.  Sigma  Perf.  up. 
positive  value  of  r,  tempe  rat  lire  up.  Delta  Airspeed  up. 
positive  value  of  r,  temjxrature  up,  Delta  ALtUmiciip. 
positive  value  of  r,  temperature  up,  Heading  limn*  up. 
positive  value  of  r,  te  mperature  up,  Delta  Torque  up. 


Pilot  G  was  not  listed  because  of  insufficient  data  . 
*  Significant  at  the  .0,5  level. 

**  Significant  at  the  .01  level. 


TABLE  6.  Correlations  Pilot  Performance  (Pj)  doctors  and  Environmental  Temperatures 


REGRESSION  CORRELATION  ANALYSIS  OE  I ’/LOT  PER  FOKMANCIC  VS.  ENVIRONMENTAL  FACTORS. 
Tables  7  and  8  summarize  the  computer  analysis  runs  which  established  Ixtween  all  data  entry  measurements 
of  the  study  the  appropriate  "lx-st  fit"  predictor  performance  equation  U^),  iioth  with  and  without  crew 
performance  Limits  applied  (described  in  Method  Section). 

The  stepwise  multiple -regression  solution  of  the  effects  of  various  temperatures  upon  performance  was  an 
attempt  to  derive  a  predictor  equation  for  |X‘rfunnanci-  based  on  environmental  temperatures  .  It  would  have 
been  most  satisfying  if  the  solution  for  each  condition  of  environmental  temperatures  had  provided  n  linear 
equation  v/ith  each  variable  in  : hided;  hut,  in  fact,  each  condition  produced  a  different  equation.  The  equations 
which  applied  limits  to  the  performance  measures  were  quite  similar  to  the  equations  lor  the  same  conditions 
without  limits,  and  the  similarity  served  to  verify  the  equations. 


Performance  Lgn.iL i t»K>  Without  IVrlnrin.HKc  l.inuh 


Ail  I* lights: 

I*.,  y-l,2lh  I  -I.  I  I8WH  •  .277WH2  i  f.  I7'X.:|2 
i  .01  IGT1  ‘  2.029  DM  .  17 1  Dll2 


2 


.028DB4  -  .4.ViWBGT ’■ 


.(HOW  KIT'* 


i  .1.4AHST  -  .353, st2  -  .  noiiT* 

4  .0721  ik  i  .oijyim2  4  .niKwiTiiK'1 
-  I  ,5721)1’  -  .OKllDI*2  l  .01121)1* 2 
+  .39IRII 
•SliortciH’il  l;»rm: 


r. 


94 .5  4  4 . 1  I8VVB  4  2 . 0241)11  f  3.46.3SI 
-  I  .5721)1* 


2.  Mnmlng  Plights  (WfUTI*  *CiH5‘*l'): 

1*2  7h.l7V  -  .375WB2  I  K.75ICT 

4  I.673GT2  I  .09401''+  3U.763RT 
-  .092D1*2  -  500.571RI 
•Shortened  l  onu: 

1*2  n  7(i.  179  4  H.7SIC5T  +  1  .(>730 12 
+  30.7ft.3Rr  -  5U0.571RT  ’ 


.3. 


Afternoon  Plights: 

r*2  -  67.025+  .423WB2  +  .0lloWB:l  -.4I2GT 
+  .3H2CT2  l  .U20GT;i  +  2.459DB 

-  .208DB2  -  .  U3 1 DB*  +  ft .  722  WBOT 

-  .549WBGT2  -  .027WBCT:i  I  2.955ST 

-  .552ST2 
+  .01  IHIt2 
+ 

•Shortened  Form; 


.  I56ST3  4  .2471 IR 
.00011  IK3  -  I  .75HDP 


UUUOSDl’’  +  .UU04RII3 


1*2  -  07.1  1-2. 4591)1)1  0.722  WIKJT 
+  2.955ST  -  I  .7581)1* 


IV-)  l*n  in. in, ,  Imiii.iI  unis  With  l\  rinnn.iiui-  l.imll.- 


1.  All  I  lij*lil 


I’ 


.SlH  •  i.w+wn  I  . 272VV112  -  .2(1  ACT 


■  .  I9-IGT-  i  .1112(1 1'-’  i  2.  1721)11 

■  .1971  Ml2  -  .02(il)R;i  -  ,40«VV!K;'r2 

-  .01.1  WIKiT  1  I  3.  1 78ST  -  ..DOST2 

-  .  I  I9.S'I :i  I  ..IIOIIR.,1  .OIOIIR2  -.onouiR:* 

-  1. 3731)1*  -  ,o7ol)r  I  .0021)1*'*+  .182R1I 

H  .001)21(11* 


•.SlmrtfiKi!  Turin 
P. 


2  llll  .518  I  3.995WB  f  2.  1721)11  I  3.178ST 
-  1  .  .1731)1* 


2.  Morning  Plights  (WIKI I'  <  H5'T): 


77.702  4  9. I02CIT 


1.081GT2  -  73.039RT2 
.000441(1!  -  623.55KT5 


-  .  U87DP 

-  .  092  GT2 
‘Shortened  I'orni: 

l*2  -  77.702  4  9. I62GT  -  1 .6«1<JT2 

-  73.U39RT2  -  623.55RTS 


3.  Afternoon  1‘  limits: 


II2  +  .OObWB3  -  .  479GT 


1*2-  78.378  +  .379WB 

+  .353GT2  4  .0I9GT3  +  2.528DB 

-  .  18.3DB2  -  .U28DB3  I  5.798WBGT 

-  .  48SWBGT2  -  .026  \VBGT:>  f  2.53ST 

-  .528ST2  -  .  149ST'*  3  .242I1R+  .OIOIIR2 

-  .000IHR3  -  1.5561)1*  1  . U27DP2 
t  .00031(11 

•Shortened  I'orin: 

1*2  =  78.378  -4  2.52 HUD  +  5.798WRGT  +2.53ST 

-  I.556DP 


•Shortened  forms  of  predictor  equation.**:  are  provided  for  e.-t-si*  of  reader  interpretation  and  to  highlight  the  more 
prominent  factors  contained  in  the  jvrformanee  equation.  It  was  derived  by  arbitrarily  dropping  all  factors 
with  a  coefficient  of  less  than  i  .0. 


TABLL  7. 


Predictor  Performance  liquations 


PerfoniKUice  Equations  with  Performance 
Limits 


4.  Hot  Plights  (WBGT  >  85°T): 

1’2  -  187.828  *  .  5668GT  -  1 .5901)1)  .  .204.SWDGT2  +  326  .  03RT  +  .348 .976RT2 

+  4.39.2  I3RT2  l  9.7947ST  -  5.351 1ST2  -  I.2024ST*1  i  1 .55251 JK  t  .08 -191  IP.2 
-  .00291  ll(*  -  .26531(1 12  -  .0II4KIP 
*  Shortened  Form: 

1*2  =  187.8  -  I  . (il)B  I  526 RT  4  849RT2  I  43>)I(TJ  ■  9.83T  -  5.4ST2  -  I  .2ST:*  4  I  .551  IK 


5.  All  Flights  with  RT,  ST  and  HR  out: 

l*2  =  08.338  I  .20 iftWB2  -  1 ,03-loGT  +  .  I55SCT2  4  .0I04GT  ’  4  2.2592DB 
-  .0295DB2  +  5.40S9WHGT  -  .  135  IWBG T2  -  .0 IS.jWBCT2  -  1.0431)1* 

+  ,000991)1 *’2  .27771(11 

‘Shortened  Form: 

P2  .  68  .4  -  1  .OCT  -  2  ..inn  t  S.4WBGT  »  I  .0DF 

•Shortened  forms  of  predictor  cqu.il inns  are  provided  for  east-  of  reader  interpretation  ami  tn  highlight  the 
more  prominent  factors  contained  in  the  |vrloi  ounce  equation.  It  was  derived  by  arbitrarily  dropping  all 
factors  with  a  coefficient  of  less  than  I  .0. 


-  .2ndinn-- 

-  .04321  H*2 


tablt: 


Predictor  IVrlnnnance  Lqiut  imm,  Sjvcial  < hmditiohs 


I/?  i  ' 


K(,.:. iipir-  2  ^tr  thi--  .mil  (morning)  flight  **  ( 1  .il.W-  ")  «  inphnsiz.-d  (lit-  jmjKjrt.inci-  of  (In*  Glolx*  Temperature  ami 
Ri  ni.ii  IVmprratun  am!  .1  s  s.fin  (|  lc.-.xcr  significance  in  Wet  llu  Hi  T|  -  111  |X  r.ir  u  n  and  I V  iv  i'ninr  Tei:i|x*i*nturr . 
Tin.  large  CnofllcieiHH  assigned  to  Rectal  iVinix-ratui'e  n  |irrsi-Mti'd  modi  rate  v  -  hies  hen  it  was  considered 
that  these  changes  were  tenths  < >1  a  degree  while,  in  general ,  the  other  va  -es  clunked  by  whole  degrees 
(lining  tilt  (light  investigated. 

The  flights  which  were  flown  under  extremely  lint  (Wilt;  I  Index  ** .V  I - ,  hqinunn  4,  Inhlt  «)  conditions 
also  emphasized  Rectal  Temperature  and  added  Skin  Temperature,  Dry  Bulb  Temperature  and  Heart  Rate 
while  assigning  a  lesser  significance  to  Globe  ronipcrature .  This  equation  also  considered  WBGT  Index  and 
Relative  Humidity  and  dropped  Wet  BulbTcsriperature  and  Dew  Point  Temperature . 

The  afternoon  scries  of  flights  (Equation  3,  Table  7),  which  Included  the  hot"  flights,  assigned  Importance 
to  Dry  Bulb  Temperature,  WBGT  Index,  Skin  Temperature,  and  Dew  Point  Temperature  .  Heart  Rate  and 
Relative  Humidity  were  also  considered  as  contributing  to  the  value  of  performance  , 

The  total  solution  of  all  flights  (Equation  1,  Figure  7)  listed  Wet  Bulb  Temperature,  Dry  Bulb  Temperature, 
Skin  Temperature  and  Dew  Point  as  the  major  variables  and  Globe  Temperature,  WBGT  Index,  Heart  Rate, 
and  Relative  Humidity  as  contributing  variables. 

The  final  equation  in  this  group  (Equation  5,  Figure  0)  considered  all  of  the  flights'  data  but  did  nut  compute 
coefficients  for  the  physiological  variabl*  s  (Rectal  temperature.  Skin  temperature  and  Heart  Rate).  The 
results  were  similar  to  those  for  the  total  flights  (Equation  1)  with  greater  importance  placed  on  Globe 
Temperature  and  WBGT  Index,  while  Wet  Bulb  Temperature  was  considered  less  Important  that  it  was  in  the 
total  flight  equation . 

EFFECT  OF  TURBULENCE  ON  PILOT  PERFORMANCE  .  There  was  a  question  of  whether  the 
difference  In  performance  between  the  "cool"  and  "hot"  flights  was  perhaps  due  to  the  turbulence  caused  by 
the  heating  of  the  ground .  Seven  of  the  flights  had  a  notation  by  the  observer  that  there  was  moderate 
turbulence  during  the  flight  .*  These  flights  were  statistically  compared  with  flights  which  had  no  such 
notation  but  which  had  the  same  pilot  and  were  matched  as  closely  as  possible  for  equal  numher  of  line 
entries  and  for  equal  WBGT  values  (see  Table  9  for  a  summary  of  the  results). 


FLIGHT 

P1 

(Limits  Applied) 

SD 

Line 

Entries 

t 

IOC* 

75.79 

24.88 

295 

3.6888 

5C 

61 .49 

39. 0U 

258 

15C* 

85.76 

18.94 

375 

11.1826 

7C 

55.54 

32.99 

366 

16L* 

96,05 

4.97 

321 

5.2246 

12L 

91.91 

9.54 

343 

19L* 

95.71 

5.80 

3yo 

-3.2540 

26L 

97.36 

3.38 

340 

20C* 

84.05 

20.22 

251 

-0.0600 

27C 

84.19 

17.21 

266 

23C* 

84.14 

19.34 

237 

-0.0216 

27C 

84.19 

17.21 

266 

24L* 

97.40 

3.46 

340 

-0.2727 

14L 

97.52 

4.07 

260 

•Turliulenci*  noted  hy  observer  and  pilot. 


TABLE  9.  Comparison  of  Pilot  Performance  During  Turbulent  aiu1. 

Nou-Turhulcnt  Flights 

*  Standard  inflight  terminology  as  used  by  the  joint  services  and  defined  in  TM  i-301)  (IB)  was  used  to 
report  the  degree  of  turbulence  encountered  during  each  flight.  These  classifications  of  turbulence  are 
selected  uncording  to  the  effect  of  the  turbulence  on  the  aircraft. 
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The  negative  values  of  t  are  the  cases  in  which  the  performance  Is  better  under  the  "hot", ton -turbulent 
conditions.  There  was  only  one  case  (Flight  19)  of  seven  in  which  there  was  an  apparent  disadvantage  due 
tc  turbclcn-e.  Duiing  tills  iiigm  turbulence  was  noted  as  Increasing  from  moderate  to  "severe.''  The 
difference  In  performance,  as  tested  by  the  t  test  was  significantly  better  than  chance  at  the  .01  level  of 
confidence . 

It  can  be  seen  that  In  both  cases  performance  generally  varied  more  under  smooth  air  conditions  than  it  did 
under  turbulent  conditions .  One  possible  reason  for  the  Improved  performance  during  turhulence  Is  that 
more  attention  Is  required  of  the  pilot . 

Additional  experimental  evidence  of  the  small  effect  of  light  and  moderate  turbulence  upon  the  performance 
of  experienced  pilots  in  helicopters  has  been  provided  In  simulator  studies  by  Nicholson,  et  al.  (9),  and 
Hornick  and  Lcfrltz  (5).  The  ic-sulis  Indicated  that  pilot  performance  was  not  significantly  affected  by  gust 
loadings  to  15K  and/or  0.20  RMS  G  intensities. 

VARIABILITY  OF  PILOT  PERFORMANCE .  The  mean  performance  for  each  pilot  during  the  entire 
study  was  as  follows: 


Mean  Perf .  (P.) 

(with  Limits) 

Total 

Pilot 

SD 

Line  Entries 

L 

94.44 

9.43 

3139 

C 

78.04 

29.49 

2715 

11 

76.74 

29.44 

900 

G 

91  .43 

15.97 

189 

TABLE  10.  Performance  Variability  Among 
Pilots 


It  can  lx-  seen  that  there  were  differences  in  the  mean  performance  of  the  pilots  who  flew  in  this  study .  This 
difference  was  made  more  pronounced  )>y  the  motliixlx  of  scoring  ixirformance  during  the  BRAVO  precision 
flight  patterns  .  While  all  tile  pilots  flew  well,  it  was  observed  during  the  flights  and  In  reviewing  the  scoring 
that  techniques  of  flying  affect  (xrlnnnance .  The  pilot  who  used  a  method  averaging  out  aircraft  attitude, 
heading  and  altitude  changes  during  the  BRAVO  flight  pattern,  scored  lower  than  die  ones  who  corrected 
iinmodbuciy  to  the  desired  msition .  Title,  variability  see. ns  to  fit  the  normal  expected  variation  of  human 
IxoTnriiumcc . 

WEIGHT  LOSS.  The  value  of  the  mean  water  loss  for  all  pilots  in  the  experiment  was  1.216  lbs.  per 
flight:  tlte  st.utdard  deviation  was  given  as  .  7734 .  Thu  range  of  those  water  losses  varied  from  .154  lbs.  to 
2 .461  lbs . ,  of  which  pilot  L  hail  the  most  variant  lily .  Because  of  hum, in  vai  iability  in  this  area,  it.  seemed 
more  meaningful  to  consider  each  pilot  separately  regarding  water  loss  versus  performance  correlation. 

Pilot  (1  was  not  listed  liecausc  of  insufficient  data .  A  summary  these  calculations  are  provided  in  Table  1 1 . 


Pilot 

Mean  Perf. 
<P;) 

Mean 

Water  Loss 

Correlation 

r 

Line 

Entries 

L 

94.21 

1 .408 

r  -  .12.32 

3139 

C 

78.04 

1.159 

r  =  .1141 

2716 

B 

77.82 

1 .073 

r  -  -  .9926 

900 

TABLE  11 .  Comparison  of  Pilot  Performance  and  Water  Loss 


For  pilot  P,  tin’  correlation  was  ne.uly  perfect,  but  the  sample  size  was  only  three  flights  as  compared  with 
ill  and  12  flights  for  the  other  pilots  . 


12-20 


INTKRAGTION  OF  TH  MPfi  R  ATI  IRE.  PERFORMANCE  AND  CLOTHING  .  B.icli  clotliini!  conflmiration 
used  by  tlie  pilots  during  the  study  Has  compared  with  their  associated  performance  (P^)  while  wearing  the 
clntlui.g.  The  results  are  summarized  in  Table  12. 


Clothing 

Configuration 

No. 

Flights 

Mean  Perf. 

C’|) 

Com  putor 
l.lnr  Kntrifs 

A 

R 

86.  OS 

2277 

B 

K 

85. KH 

2183 

C 

9 

82.76 

2162 

D 

l 

95.70 

322 

TABLE  12.  Comparison  of  Pilot  Performance  and 
Clothing  Configurations 


The  performances  using  clothing  configurations  A  and  B,  both  of  which  Include  oody  armor,  are  for  all 
purposes  identical.  The  performance  using  clothing  configuration  C,  which  does  not  Include  armor,  is 
somewhat  lower  than  tlie  others  hut  not  significantly  so.  Performance  wearing  clntlting  configuration  D  is 
not  a  true  representation  of  this  configuration  ns  it  refers  to  only  one  pilot  and  one  flight;  hence,  even  though 
the  performance  is  bettor  than  with  any  other  configuration,  It  cannot  lie  considered  as  a  preferred  configura¬ 
tion  without  further  testing.  The  pilots'  subjective  comments  regarding  the  I)  clothing  configuration  Indicated 
it  was  completely  unacceptable  , 

TARGET  IDENTIFICATION  TASK.  The  data  was  analyzed  for  variations  hi  pilot  performance  due  to 
indivi  dual  differences,  clothing  differences  and  fatigue,  and  differences  hi  environmental  temperature.  A 
total  of  348  target  displays  Were  presented  to  the  pilots  during  22  (lights  providing  usable  data.  Of  the  348 
target  tUsplays,  228  were  correctly  identified,  89  were  incorrectly  identified  and  31  were  not  detected. 

During  the  22  flights  the  pilots  flew  five  flights  with  A,  six  with  B,  ten  with  C  and  one  with  D  clothing 
configurations . 

The  data  were  analyzed  using  W3GT  index  as  the  environmental  measure  with  a  mode  of  85°F.  The  flights 
were  broken  into  two  groups,  A.M  and  I’M.  No  AM  (Lights  had  a  WBGT  greater  than  86°.  The  results  showed 
that  there  wore  no  significant  differences  in  pilot  performances.  There  was  no  significant  difference  between 
performance  duringthc  first  part  of  the  flights  and  performance  during  the  latter  part  of  die  flights.  There 
was  a  trend  indicating  a  difference  fn  performance  due  to  clothing,  but  this  was  not  significant  at  the  .  1  level . 

The  PM  flights  show  a  greater  number  of  errors  occurring  when  armor  was  worn  and  the  WBGT  was  greater 
than  85°.  In  the  cases  when  no  armor  was  worn,  the  errors  occurring  in  each  temperature  zone  were 
approximately  equal.  The  results  Indicate  that  trends  were  present  but  were  not  significant  at  the  .  1  level. 

REACTION/RESPONSE  TIME  MEASURES.  Pilot  reaction  times  and  response  times  were  measured 
30  to  40  times  per  flight .  The  range  of  mean  reaction  tines  for  all  pilots  during  the  study  varied  from  .23 
to  .63  seconds,  with  an  overall  mean  of  .44  seconds.  Response  times  varied  from  .41  to  1 .21  seconds,  with 
an  overall  mean  of  .93  seconds. 

Pilot  reaction  times  were  taken  in  a  more  consistent  manner  than  response  time  measures;  the  results  contained 
smaller  ranges  of  values  and  smaller  variability.  Only  reaction  times  were,  therefore,  considered  reliable 
enough  to  be  reported  and  arc  summarized  in  Table  13. 

The  correlation  analysis  of  the  data  indicates  a  trend  showing  an  increase  hi  pilot  reaction  time  as  cither 
Rectal  Temperature  or  the  WBGT  Index  increases. 


12-21 


Mca.su  roil 

Comiition 

Pilots  ••  | 

L  (n  *  9) 

C  in  =  9) 

B  (n  =  3) 

Reaction  Time 
vs.  WBGT 
(seconds) 

.4.10 

.  124 

.994* 

Reaction  Time 
vs .  Rectal  Temp, 
(seconds) 

.220 

.380 

.993* 

*  Significant  at  the  .1)5  level. 

**  The  n  values  shown  for  the  pilots  represent  the  means  of  234  repeated 
measures  from  several  flights  (Pilot  G  Was  not  listed  because  only 
one  flight  was  available  for  analysis) . 

TABLE  13.  Correlation  of  Reaction  Times  with  Temperature 

Measures 


COMPARISON  Ob'  GROUND  AND  AIRBORNE  WBGT.  During  the  earlier  portion  of  the  study  It  was 
hypothesized  that  perliaps  a  fixed  relationship  (similar  to  a  standard  adiabatic  lapse  rate  of  temperature)  may 
exist  between  the  WBGT  Index  measured  at  ground  level  and  that  measured  In  the  aircraft,  assuming  that  the 
measurements  were  taken  during  the  same  time  period  and  that  the  aircraft  maintained  the  same  airspeed  and 
absolute  altitude,  and  remained  v.'thin  the  local  area  (5-10  miles).  It  was  hoped  that  if  a  reasonably  constant 
relationship  did  exist,  then  perhaps  ground  measurement  of  cockpit  WBGT  would  help  schedule  the  aircraft 
for  the  desired  above  85°F  WBGT  flight  conditions. 

Unfortunately,  no  constant  relationship  could  be  determined  between  cirborne  measurements  of  WBGT  and  those 
taken  on  the  ground.  In  18  out  of  28  cases  compared,  the  airl  omc  measured  WBGT  was  greater  than  the  WBGT 
measured  on  the  ground  during  the  same  time  frame.  The  range  of  differences  between  ground  WBGT  and 
airborne  WBGT  was  4.64  to  -15.29.  The  mean  difference  was  -2.4157  and  the  sigma  was  4.56. 

PILOT  COMMENTS  AND  OBSERVATIONS,  All  of  the  pilots  expressed  a  desire  for  Improved  ventilation 
in  tile  crew  station  . 

Figure  7  summarizes  the  rating  scale  of  pilots'  judgments  of  the  clew  station  environment.  Their  judgments 
are  compared  with  the  actual  WB.  DB,  C.T  and  WBGT  Index,  as  measured  during  each  flight  in  which  the  pilot 
reported  a  specific  rating  scale  index.  During  the  study,  no  attempts  were  made  to  inform  the  pilots  of  how 
their  subjective  ratings  of  crew  station  environment  compared  with  the  actual  measured  temperatures . 

Tile  pilots'  ratings  of  a  "cool"  or  "warm"  environment  included  very  large  overlaps  and  very  large  ranges  ol 
each  temperature  measured.  Some  flights  were  actually  hotter  than  others  they  rated  as  "hot" or  "very  hot." 

If  only  mean  (X)  temperature  values  arc  considered,  Figure  7  indicates  that  pilot  ratings  tended  to  parallel 
actual  increases  in  Globe  and  Dry  Eulb  Temperatures  when  reporting  their  estimates  of  "cool,"  "warm," 

"hot"  and  "very  hot."  When  the  environment  was  judged  as  "hot,"  the  range-  of  actual  temperature  was  smaller 
than  when  the  ratings  were  "cool"  or  "warm";  however,  the  number  ol  times  "hot"  was  selected  Was  also  less, 
which  could  account  for  the  smaller  range.  "Very  hot"  was  selected  only  once. 

One  conclusion  which  can  be  drawn  from  these  data  is  that  pilot  judgment  of  cockpit  environmental  temperature 
is  inconsistent  and  appears  to  be  unreliable  as  a  means  of  assessing  actual  environmenl. 

(Detailed  pilot  comments  regarding  clothing  and  survival  equipment  fit  and  problem  areas  were  not  considered 
to  be  appropriate  to  tide  paper,  and,  therefore,  are  not  presented.  These  comments  can  be  oltained  upon 
written  request  to  the  authors.) 
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MISCELLANEOUS  COMENIS  AND  DATA.  The  following  recorded  data  extracts  and  c™«n»n>: 
regarding  the  crew  station  envi crc  provided  Tor  general  reader  interest: 

1.  iXuring  flight  (at  800  ft.  absolute  altitude),  the  cockpit  WBCT  Index  frequently  rose 
above  90*F  and  occasionally  reached  95*F  and  97*F.  The  highest  recorded  WEGT  Index  was  lOS.l’F 
(Fir,  9L:WB  5?*F,  CT  127.5  F,  DB  1174F). 

2.  DB  tenperatures  taken  at  the  seat  reference  point  (SRP)  of  the  passenger  compartment 
soat  measured  110*F-118*F  when  the  cockpit  environment  measured  1Q2*-105“f.  Sene  of  this  heat  was 
believed  to  be  radiated  heat  generated  from  the  engine  and  transmission. 

3.  Ground  reflected  solar  radiation  appeared  to  cause  rapid  increases  in  overall  cockpit 
DB  temperatures  when  the  aircraft  was  at  or  passing  through  200  ft.  absolute  altitude.  It  was  not 
ur.ccmaon  for  the  overall  cockpit  DB  temperatures  to  raise  from  90*F  to  above  110*F  within  50 
seconds . 


4.  With  the  aircraft  sitting  on  the  ground  with  a  bright  sun  and  DB  of  85*-90®F,  cockpit 
doors  and  vents  closed,  the  cockpit  0B  would  rise  to  15S*F,  the  maximim  point  on  the  temperature 
scale. 


5.  The  old  problem  of  testing  enough  subjeecs  to  get  a  significant  n  need  not  be  a 
limitation  in  an  aircraft.  During  the  two  month  period  of  optima:;  weather  for  this  study  10  to 
20  subjects  could  have  been  tested,  provided  a  modest  increase  in  the  manpower  and  aircraft 
resources  were  made  available. 

6.  If  a  magnetic  tape  recording  system  was  substituted  for  the  photopanel  technique  and 
many  of  the  manual  recording  tasks  performed  by  the  inflight  observers  of  this  study,  the  data 
recording  and  analysis  of  the  flights  would  have  been  greatly  unburdened  and  the  number  of  inflight 
observers  could  have  been  reduced. 

7.  Air  velocity  measurements  of  the  cockpit  taken  with  a  hot  wire  anemometer  were  as 
follows : 


Flight 

Vent 

Probe 

Rate  of 
ft /min, 

air  movement, 
at  level  of: 

Average  air 
movement , 

Mode 

Settings 

Position 

tie  ad 

^lip 

Tod 

ft/min 

Slow 

Cruise 

(80K) 

Vents 

Closed* 

Vents 

Open 

R 

C 

L 

R 

C 

L 

30 

20 

25 

160 

210 

480 

30 

25 

25 

300 

150 

110 

35 

50 

40 

4S 

50 

85 

32 

32 

30 

168 

137 

225 

Probe  position:  R  ■  2"  to  right  of  body 

C  *  in  mid-body  plane,  2"  in  front  of  body  or  between  legs 
L  *  2"  to  left  of  body 

‘The  vent  closed  position  was  used  during  this  study. 

TABLE  14,  Cockpit  Air  Movement  Measures 


1.  Breaux,  11.  J. 
Campbell,  L.  W. 
Torrey,  J.  C. 

2.  UuBois,  E.  F. 


3.  Hall,  J.  F.,  Jr. 
Klenn,  F.  K. 


4.  Hendler,  E. 
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TECHNICAL  EVALUATION 


The  meeting  was  opened  by  the  Chairman  of  the  Aerospace  Medical  Panel  of  AGARD, 

Professor  Dr.  E.A.  Lauschner,  Brigadier  General  MC,  GAF,  who  welcomed  the  participants  and 
outlined  the  objective  of  the  symposium.  He  pointed  out  that  the  measurement  of  flight  deck  work¬ 
load  and  its  relation  to  pilot  performance  was  a  complex  problem  of  relevance  to  both  the  opera¬ 
tional  commander  and  his  aeromedlcai  counterpart.  These  topics  could  not  be  covered  exhaus¬ 
tively  during  the  course  o:  a  short  meeting,  though  he  considered  that  the  papers  to  be  presented 
highlighted  Important  aspects  of  the  problem. 

The  Chairman' s  opinion  was  substantially  justified  during  the  subsequent  one  and  a  half 
days,  when  eleven  papers  were  presented  to  an  audience  of  some  ninety-six  participants. 

Many  of  the  papers  presented  emphasised  the  Integra. ive  nature  of  the  workload  concept, 
although  three  were  primarily  concerned  with  the  effect  of  specific  stresses,  such  as  sleep  loss 
and  thermal  stress.  The  Importance  of  that  phase  in  flight  when  the  pilot' s  task  is  the  most 
demanding  and  the  consequences  of  failure  the  moot  disastrous,  namely  approach  and  landing,  was 
emphasised  in  at  least  four  papers.  Three  papers  dealt  with  manipulation  of  workload  and  its 
effect  on  performance  during  simulated  flight,  while  three  papers  described  in-flight  measurements 
of  passible  physiological  indicants  of  workload. 

OBSERVATIONS  AND  RECOMMENDATIONS 

Workload 

Despite  recognition  of  the  great  majority  of  the  environmental  and  task  generated  stresses 
to  which  the  aviator  is  exposed,  the  manner  in  which  they  interact,  like  their  combined  effect  upon 
operational  efficiency,  is  inadequately  understood.  In  order  to  overcome  some  of  the  difficulties 
r.  isociatcd  with  an  analytic  approach  to  the  study  of  the  effect  of  multiple  stresses  of  the  flight 
environment,  the  integrative  concept  of  workload  has  been  Introduced.  It  is  convenient  to  divide 
workload  in  a  temporal  manner: 

1.  Immediate  workload,  i,e.  any  workload  experienced  over  a  particular  short  period  of 
time; 

2.  Duty-day  workload,  i.  r  the  summation  of  the  short-term  workloads  experienced 
during  a  working  day; 

3.  Long-term  workload,  i.e.  the  summation  of  duty-day  workloads  over  a  sequence  of 
working  days. 

Measurement  of  Workload 

The  study  of  physiological  variables,  (such  as  heart  rate  or  oxygen  consumption)  which 
might  serve  ns  usetu!  measures  of  workload,  were  discussed  by  several  authors.  It  would 
appear  that  these  physiological  measures,  whilst  providing  an  indicant  of  heightened  behavioral 
arousal  and  energy  expenditure  in  response  fo  short-term  increments  in  workload,  their  value, 
per  sc,  in  the  evaluation  and  estimation  of  workload  over  longer  time  periods  awaits  substantiation. 

The  use  of  physiological  measures  in  conjunction  with  subjective  evaluation  of  the  environ¬ 
mental  and  task-enduced  stresses  may  have  greater  relevance  in  operation  situations:  a  conclusion 
supported  hy  the  r  eport  of  a  significant  correlation  between  linger  tremor  and  the  complexity  of 
approach  and  landing. 

Despite  the  considerable  research  effort  which  ha:,  been  expended  on  the  recording  of 
physiological  variables  in  real  and  simulated  flight,  the  interpretation  of  such  data  in  relation  to 
pilot  workload  still  awaits  clarification. 

THE  COMPONENTS  OF  WORKLOAD 

!.  Physical  Stresses 

These  were  not  discussed  comprehensively,  though  the  importance  of  thermal  stress  and 
its  deleterious  effect  on  pitot  performance  was  underlined  in  two  papers.  Evidence  was  presented 
that  pilot  performance  during  helicopter  flight  was  degraded  and  performance  variability  increased 
above  a  WBGT  index  of  85UF.  There  is  a  need  for  agreement  on  a  measurement  index  which 
would  mainUin  its  validity  in  different  environmental  situations  and  allow  "thermal  stress"  to  be 


operationally  defined. 


The  contribution  of  abnormal  force  environments  (c.g  vibration)  to  workload  and  the  inter¬ 
action  of  physical  stresses  were  topics  which  unfortunately  were  not  raised  in  formal  communi¬ 
cations  or  discussions. 

2.  Sleep  Loss 


The  results  of  anamnestic  studies  indicated  that  accumulated  sleep  loss,  olten  arising  from 
the  disruption  of  normal  day-night  duty  cycles,  was  a  major  factor  in  the  determination  of  long¬ 
term  workload.  Due  attention  tc  the  organisation  of  duty  sequences  in  relation  to  established 
diurnal  patterns  can  do  much  to  minimise  sleep  loss  and  maintain  the  operational  efficiency  of 
flying  personnel.  Experimental  studies  have  shown  that  effective  performance  is  more  dependent 
upon  the  total  amount  of  sleep  obtained  in  the  previous  twenty-four  hours  than  on  the  type  of  sleep. 
The  use  of  drugs  to  obtain  adequate  sleep  when  working  disruptive  duty  schedules  was  rained  in 
discussion.  It  was  apparent  that  more  information  was  requested  on  the  advantages  and  disadvan¬ 
tages  of  the  pharmacological  regulation  of  the  sleep  of  aircrew. 

3.  The  Flying  Task 

The  Importance  of  the  approach  and  landing  phase  of  flights  as  a  period  of  high  workload 
was  emphasised  by  the  fact  that  at  least  one  third  of  the  papers  presented  were  concerned  with 
some  facet  of  this  topic. 

A  study  of  the  accuracy  of  approach  and  the  success  of  landing  on  aircraft  carriers 
analysed  the  factors  which  contribute  to  the  degraded  precision  of  approach  and  the  higher  accident 
rate  during  night  operations.  The  need  for  better  visual  landing  aids  was  adduced. 

The  errors  associated  with  landing  at  night  on  conventional  airfields  is  being  studied  with 
the  aid  of  a  special  purpose  simulator.  It  has  been  shown  that  pilots  using  visual  cues  alone  are 
generally  unable  to  judge  a  safe  approach  altitude  when  the  terrain  has  an  upwards  slope:  they 
fly  too  high  when  only  the  airfield  lights  are  visible  and  they  tend  to  use  the  pattern  of  city  lights 
as  a  horizontal  reference,  even  when  this  is  in  error.  An  increase  in  workload  during  a  simulated 
night  visual  landing  did  not  of  itself  cause  a  significant  decrement  in  performance,  although  it 
interacted  with  terrain  slope  and  pilot  differences.  The  broad  conclusions  of  this  study,  that 
night  visual  approach  accidents  would  probably  be  less  if  instruments  and  other  aids  were 
employed  during  this  critical  phase  of  flight,  is  worthy  of  note. 
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